0s autopkgtest [00:17:31]: starting date and time: 2024-11-24 00:17:31+0000 0s autopkgtest [00:17:31]: git checkout: 6f3be7a8 Fix armhf LXD image generation for plucky 0s autopkgtest [00:17:31]: host juju-7f2275-prod-proposed-migration-environment-20; command line: /home/ubuntu/autopkgtest/runner/autopkgtest --output-dir /tmp/autopkgtest-work.4ng3kntr/out --timeout-copy=6000 --setup-commands /home/ubuntu/autopkgtest-cloud/worker-config-production/setup-canonical.sh --apt-pocket=proposed=src:python3-defaults --apt-upgrade dask.distributed --timeout-short=300 --timeout-copy=20000 --timeout-test=20000 --timeout-build=20000 --env=ADT_TEST_TRIGGERS=python3-defaults/3.12.7-1 -- ssh -s /home/ubuntu/autopkgtest/ssh-setup/nova -- --flavor autopkgtest-big --security-groups autopkgtest-juju-7f2275-prod-proposed-migration-environment-20@bos03-arm64-38.secgroup --name adt-plucky-arm64-dask.distributed-20241123-203206-juju-7f2275-prod-proposed-migration-environment-20-5e55d8b5-433b-4605-8343-758bb674b3c2 --image adt/ubuntu-plucky-arm64-server --keyname testbed-juju-7f2275-prod-proposed-migration-environment-20 --net-id=net_prod-proposed-migration -e TERM=linux -e ''"'"'http_proxy=http://squid.internal:3128'"'"'' -e ''"'"'https_proxy=http://squid.internal:3128'"'"'' -e ''"'"'no_proxy=127.0.0.1,127.0.1.1,login.ubuntu.com,localhost,localdomain,novalocal,internal,archive.ubuntu.com,ports.ubuntu.com,security.ubuntu.com,ddebs.ubuntu.com,changelogs.ubuntu.com,keyserver.ubuntu.com,launchpadlibrarian.net,launchpadcontent.net,launchpad.net,10.24.0.0/24,keystone.ps5.canonical.com,objectstorage.prodstack5.canonical.com'"'"'' --mirror=http://ftpmaster.internal/ubuntu/ 66s autopkgtest [00:18:37]: testbed dpkg architecture: arm64 67s autopkgtest [00:18:37]: testbed apt version: 2.9.8 67s autopkgtest [00:18:37]: @@@@@@@@@@@@@@@@@@@@ test bed setup 67s Get:1 http://ftpmaster.internal/ubuntu plucky-proposed InRelease [73.9 kB] 67s Get:2 http://ftpmaster.internal/ubuntu plucky-proposed/multiverse Sources [13.6 kB] 67s Get:3 http://ftpmaster.internal/ubuntu plucky-proposed/universe Sources [892 kB] 68s Get:4 http://ftpmaster.internal/ubuntu plucky-proposed/main Sources [49.1 kB] 68s Get:5 http://ftpmaster.internal/ubuntu plucky-proposed/restricted Sources [9704 B] 68s Get:6 http://ftpmaster.internal/ubuntu plucky-proposed/main arm64 Packages [74.7 kB] 68s Get:7 http://ftpmaster.internal/ubuntu plucky-proposed/restricted arm64 Packages [57.8 kB] 68s Get:8 http://ftpmaster.internal/ubuntu plucky-proposed/universe arm64 Packages [748 kB] 68s Get:9 http://ftpmaster.internal/ubuntu plucky-proposed/multiverse arm64 Packages [19.3 kB] 68s Fetched 1938 kB in 1s (2034 kB/s) 68s Reading package lists... 71s Reading package lists... 72s Building dependency tree... 72s Reading state information... 73s Calculating upgrade... 74s The following package was automatically installed and is no longer required: 74s libsgutils2-1.46-2 74s Use 'sudo apt autoremove' to remove it. 74s The following NEW packages will be installed: 74s libsgutils2-1.48 74s The following packages will be upgraded: 74s bash bpftrace curl debconf debconf-i18n distro-info dracut-install 74s fwupd-signed gir1.2-girepository-2.0 gir1.2-glib-2.0 hostname init 74s init-system-helpers libaudit-common libaudit1 libcurl3t64-gnutls libcurl4t64 74s libgirepository-1.0-1 libglib2.0-0t64 libglib2.0-data liblzma5 74s libpam-modules libpam-modules-bin libpam-runtime libpam0g libplymouth5 74s libpython3-stdlib libselinux1 libsemanage-common libsemanage2 linux-base 74s lxd-installer openssh-client openssh-server openssh-sftp-server 74s pinentry-curses plymouth plymouth-theme-ubuntu-text python3 python3-blinker 74s python3-dbus python3-debconf python3-gi python3-jsonschema-specifications 74s python3-minimal python3-rpds-py python3-yaml sg3-utils sg3-utils-udev 74s vim-common vim-tiny xxd xz-utils 74s 53 upgraded, 1 newly installed, 0 to remove and 0 not upgraded. 74s Need to get 12.2 MB of archives. 74s After this operation, 2953 kB of additional disk space will be used. 74s Get:1 http://ftpmaster.internal/ubuntu plucky/main arm64 bash arm64 5.2.32-1ubuntu2 [791 kB] 74s Get:2 http://ftpmaster.internal/ubuntu plucky/main arm64 hostname arm64 3.25 [11.0 kB] 74s Get:3 http://ftpmaster.internal/ubuntu plucky/main arm64 init-system-helpers all 1.67ubuntu1 [39.1 kB] 74s Get:4 http://ftpmaster.internal/ubuntu plucky/main arm64 libaudit-common all 1:4.0.2-2ubuntu1 [6578 B] 74s Get:5 http://ftpmaster.internal/ubuntu plucky/main arm64 libaudit1 arm64 1:4.0.2-2ubuntu1 [54.2 kB] 74s Get:6 http://ftpmaster.internal/ubuntu plucky/main arm64 debconf-i18n all 1.5.87ubuntu1 [204 kB] 74s Get:7 http://ftpmaster.internal/ubuntu plucky-proposed/main arm64 python3-minimal arm64 3.12.7-1 [27.4 kB] 74s Get:8 http://ftpmaster.internal/ubuntu plucky-proposed/main arm64 python3 arm64 3.12.7-1 [24.0 kB] 74s Get:9 http://ftpmaster.internal/ubuntu plucky-proposed/main arm64 libpython3-stdlib arm64 3.12.7-1 [10.0 kB] 74s Get:10 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-debconf all 1.5.87ubuntu1 [4156 B] 75s Get:11 http://ftpmaster.internal/ubuntu plucky/main arm64 debconf all 1.5.87ubuntu1 [124 kB] 75s Get:12 http://ftpmaster.internal/ubuntu plucky/main arm64 libpam0g arm64 1.5.3-7ubuntu4 [68.6 kB] 75s Get:13 http://ftpmaster.internal/ubuntu plucky/main arm64 libselinux1 arm64 3.7-3ubuntu1 [81.6 kB] 75s Get:14 http://ftpmaster.internal/ubuntu plucky/main arm64 libpam-modules-bin arm64 1.5.3-7ubuntu4 [50.4 kB] 75s Get:15 http://ftpmaster.internal/ubuntu plucky/main arm64 libpam-modules arm64 1.5.3-7ubuntu4 [285 kB] 75s Get:16 http://ftpmaster.internal/ubuntu plucky/main arm64 init arm64 1.67ubuntu1 [6428 B] 75s Get:17 http://ftpmaster.internal/ubuntu plucky/main arm64 openssh-sftp-server arm64 1:9.9p1-3ubuntu2 [36.8 kB] 75s Get:18 http://ftpmaster.internal/ubuntu plucky/main arm64 openssh-server arm64 1:9.9p1-3ubuntu2 [524 kB] 75s Get:19 http://ftpmaster.internal/ubuntu plucky/main arm64 openssh-client arm64 1:9.9p1-3ubuntu2 [920 kB] 75s Get:20 http://ftpmaster.internal/ubuntu plucky/main arm64 libpam-runtime all 1.5.3-7ubuntu4 [40.8 kB] 75s Get:21 http://ftpmaster.internal/ubuntu plucky/main arm64 liblzma5 arm64 5.6.3-1 [138 kB] 75s Get:22 http://ftpmaster.internal/ubuntu plucky/main arm64 libsemanage-common all 3.7-2build1 [7186 B] 75s Get:23 http://ftpmaster.internal/ubuntu plucky/main arm64 libsemanage2 arm64 3.7-2build1 [92.2 kB] 75s Get:24 http://ftpmaster.internal/ubuntu plucky/main arm64 distro-info arm64 1.12 [19.4 kB] 75s Get:25 http://ftpmaster.internal/ubuntu plucky/main arm64 gir1.2-girepository-2.0 arm64 1.82.0-2 [25.2 kB] 75s Get:26 http://ftpmaster.internal/ubuntu plucky/main arm64 gir1.2-glib-2.0 arm64 2.82.2-3 [182 kB] 75s Get:27 http://ftpmaster.internal/ubuntu plucky/main arm64 libglib2.0-0t64 arm64 2.82.2-3 [1560 kB] 75s Get:28 http://ftpmaster.internal/ubuntu plucky/main arm64 libgirepository-1.0-1 arm64 1.82.0-2 [83.0 kB] 75s Get:29 http://ftpmaster.internal/ubuntu plucky/main arm64 libglib2.0-data all 2.82.2-3 [51.7 kB] 75s Get:30 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-dbus arm64 1.3.2-5build4 [109 kB] 75s Get:31 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-gi arm64 3.50.0-3build1 [279 kB] 75s Get:32 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-yaml arm64 6.0.2-1build1 [164 kB] 75s Get:33 http://ftpmaster.internal/ubuntu plucky/main arm64 vim-tiny arm64 2:9.1.0861-1ubuntu1 [805 kB] 75s Get:34 http://ftpmaster.internal/ubuntu plucky/main arm64 vim-common all 2:9.1.0861-1ubuntu1 [395 kB] 75s Get:35 http://ftpmaster.internal/ubuntu plucky/main arm64 xxd arm64 2:9.1.0861-1ubuntu1 [67.3 kB] 75s Get:36 http://ftpmaster.internal/ubuntu plucky/main arm64 libplymouth5 arm64 24.004.60-2ubuntu3 [141 kB] 75s Get:37 http://ftpmaster.internal/ubuntu plucky/main arm64 plymouth-theme-ubuntu-text arm64 24.004.60-2ubuntu3 [9914 B] 75s Get:38 http://ftpmaster.internal/ubuntu plucky/main arm64 plymouth arm64 24.004.60-2ubuntu3 [135 kB] 75s Get:39 http://ftpmaster.internal/ubuntu plucky/main arm64 xz-utils arm64 5.6.3-1 [272 kB] 75s Get:40 http://ftpmaster.internal/ubuntu plucky/main arm64 bpftrace arm64 0.21.2-2ubuntu3 [1854 kB] 75s Get:41 http://ftpmaster.internal/ubuntu plucky/main arm64 curl arm64 8.9.1-2ubuntu3 [235 kB] 75s Get:42 http://ftpmaster.internal/ubuntu plucky/main arm64 libcurl4t64 arm64 8.9.1-2ubuntu3 [365 kB] 75s Get:43 http://ftpmaster.internal/ubuntu plucky/main arm64 dracut-install arm64 105-2ubuntu2 [34.7 kB] 75s Get:44 http://ftpmaster.internal/ubuntu plucky/main arm64 fwupd-signed arm64 1.55+1.7-1 [30.9 kB] 75s Get:45 http://ftpmaster.internal/ubuntu plucky/main arm64 libcurl3t64-gnutls arm64 8.9.1-2ubuntu3 [359 kB] 75s Get:46 http://ftpmaster.internal/ubuntu plucky/main arm64 libsgutils2-1.48 arm64 1.48-0ubuntu1 [118 kB] 75s Get:47 http://ftpmaster.internal/ubuntu plucky/main arm64 linux-base all 4.10.1ubuntu1 [34.8 kB] 75s Get:48 http://ftpmaster.internal/ubuntu plucky/main arm64 lxd-installer all 10 [5264 B] 75s Get:49 http://ftpmaster.internal/ubuntu plucky/main arm64 pinentry-curses arm64 1.3.1-0ubuntu2 [38.5 kB] 75s Get:50 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-blinker all 1.9.0-1 [10.7 kB] 75s Get:51 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-rpds-py arm64 0.21.0-2ubuntu1 [302 kB] 75s Get:52 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-jsonschema-specifications all 2023.12.1-2 [9116 B] 75s Get:53 http://ftpmaster.internal/ubuntu plucky/main arm64 sg3-utils arm64 1.48-0ubuntu1 [999 kB] 75s Get:54 http://ftpmaster.internal/ubuntu plucky/main arm64 sg3-utils-udev all 1.48-0ubuntu1 [6608 B] 76s Preconfiguring packages ... 76s Fetched 12.2 MB in 1s (10.2 MB/s) 76s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 76s Preparing to unpack .../bash_5.2.32-1ubuntu2_arm64.deb ... 76s Unpacking bash (5.2.32-1ubuntu2) over (5.2.32-1ubuntu1) ... 76s Setting up bash (5.2.32-1ubuntu2) ... 76s update-alternatives: using /usr/share/man/man7/bash-builtins.7.gz to provide /usr/share/man/man7/builtins.7.gz (builtins.7.gz) in auto mode 76s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 76s Preparing to unpack .../hostname_3.25_arm64.deb ... 76s Unpacking hostname (3.25) over (3.23+nmu2ubuntu2) ... 76s Setting up hostname (3.25) ... 77s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 77s Preparing to unpack .../init-system-helpers_1.67ubuntu1_all.deb ... 77s Unpacking init-system-helpers (1.67ubuntu1) over (1.66ubuntu1) ... 77s Setting up init-system-helpers (1.67ubuntu1) ... 77s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 77s Preparing to unpack .../libaudit-common_1%3a4.0.2-2ubuntu1_all.deb ... 77s Unpacking libaudit-common (1:4.0.2-2ubuntu1) over (1:4.0.1-1ubuntu2) ... 77s Setting up libaudit-common (1:4.0.2-2ubuntu1) ... 77s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 77s Preparing to unpack .../libaudit1_1%3a4.0.2-2ubuntu1_arm64.deb ... 77s Unpacking libaudit1:arm64 (1:4.0.2-2ubuntu1) over (1:4.0.1-1ubuntu2) ... 77s Setting up libaudit1:arm64 (1:4.0.2-2ubuntu1) ... 77s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 77s Preparing to unpack .../debconf-i18n_1.5.87ubuntu1_all.deb ... 77s Unpacking debconf-i18n (1.5.87ubuntu1) over (1.5.86ubuntu1) ... 77s Preparing to unpack .../python3-minimal_3.12.7-1_arm64.deb ... 77s Unpacking python3-minimal (3.12.7-1) over (3.12.6-0ubuntu1) ... 77s Setting up python3-minimal (3.12.7-1) ... 78s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 78s Preparing to unpack .../python3_3.12.7-1_arm64.deb ... 78s Unpacking python3 (3.12.7-1) over (3.12.6-0ubuntu1) ... 78s Preparing to unpack .../libpython3-stdlib_3.12.7-1_arm64.deb ... 78s Unpacking libpython3-stdlib:arm64 (3.12.7-1) over (3.12.6-0ubuntu1) ... 78s Preparing to unpack .../python3-debconf_1.5.87ubuntu1_all.deb ... 78s Unpacking python3-debconf (1.5.87ubuntu1) over (1.5.86ubuntu1) ... 78s Preparing to unpack .../debconf_1.5.87ubuntu1_all.deb ... 78s Unpacking debconf (1.5.87ubuntu1) over (1.5.86ubuntu1) ... 78s Setting up debconf (1.5.87ubuntu1) ... 78s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 78s Preparing to unpack .../libpam0g_1.5.3-7ubuntu4_arm64.deb ... 78s Unpacking libpam0g:arm64 (1.5.3-7ubuntu4) over (1.5.3-7ubuntu2) ... 79s Setting up libpam0g:arm64 (1.5.3-7ubuntu4) ... 79s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 79s Preparing to unpack .../libselinux1_3.7-3ubuntu1_arm64.deb ... 79s Unpacking libselinux1:arm64 (3.7-3ubuntu1) over (3.5-2ubuntu5) ... 79s Setting up libselinux1:arm64 (3.7-3ubuntu1) ... 79s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 79s Preparing to unpack .../libpam-modules-bin_1.5.3-7ubuntu4_arm64.deb ... 79s Unpacking libpam-modules-bin (1.5.3-7ubuntu4) over (1.5.3-7ubuntu2) ... 79s Setting up libpam-modules-bin (1.5.3-7ubuntu4) ... 79s pam_namespace.service is a disabled or a static unit not running, not starting it. 80s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 80s Preparing to unpack .../libpam-modules_1.5.3-7ubuntu4_arm64.deb ... 80s Unpacking libpam-modules:arm64 (1.5.3-7ubuntu4) over (1.5.3-7ubuntu2) ... 80s Setting up libpam-modules:arm64 (1.5.3-7ubuntu4) ... 80s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 80s Preparing to unpack .../init_1.67ubuntu1_arm64.deb ... 80s Unpacking init (1.67ubuntu1) over (1.66ubuntu1) ... 80s Preparing to unpack .../openssh-sftp-server_1%3a9.9p1-3ubuntu2_arm64.deb ... 80s Unpacking openssh-sftp-server (1:9.9p1-3ubuntu2) over (1:9.7p1-7ubuntu5) ... 80s Preparing to unpack .../openssh-server_1%3a9.9p1-3ubuntu2_arm64.deb ... 80s Unpacking openssh-server (1:9.9p1-3ubuntu2) over (1:9.7p1-7ubuntu5) ... 80s Preparing to unpack .../openssh-client_1%3a9.9p1-3ubuntu2_arm64.deb ... 80s Unpacking openssh-client (1:9.9p1-3ubuntu2) over (1:9.7p1-7ubuntu5) ... 80s Preparing to unpack .../libpam-runtime_1.5.3-7ubuntu4_all.deb ... 80s Unpacking libpam-runtime (1.5.3-7ubuntu4) over (1.5.3-7ubuntu2) ... 80s Setting up libpam-runtime (1.5.3-7ubuntu4) ... 81s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80004 files and directories currently installed.) 81s Preparing to unpack .../liblzma5_5.6.3-1_arm64.deb ... 81s Unpacking liblzma5:arm64 (5.6.3-1) over (5.6.2-2) ... 81s Setting up liblzma5:arm64 (5.6.3-1) ... 81s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80004 files and directories currently installed.) 81s Preparing to unpack .../libsemanage-common_3.7-2build1_all.deb ... 81s Unpacking libsemanage-common (3.7-2build1) over (3.5-1build6) ... 81s Setting up libsemanage-common (3.7-2build1) ... 81s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80003 files and directories currently installed.) 81s Preparing to unpack .../libsemanage2_3.7-2build1_arm64.deb ... 81s Unpacking libsemanage2:arm64 (3.7-2build1) over (3.5-1build6) ... 81s Setting up libsemanage2:arm64 (3.7-2build1) ... 81s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80003 files and directories currently installed.) 81s Preparing to unpack .../00-distro-info_1.12_arm64.deb ... 81s Unpacking distro-info (1.12) over (1.9) ... 81s Preparing to unpack .../01-gir1.2-girepository-2.0_1.82.0-2_arm64.deb ... 81s Unpacking gir1.2-girepository-2.0:arm64 (1.82.0-2) over (1.80.1-4) ... 81s Preparing to unpack .../02-gir1.2-glib-2.0_2.82.2-3_arm64.deb ... 81s Unpacking gir1.2-glib-2.0:arm64 (2.82.2-3) over (2.82.1-0ubuntu1) ... 81s Preparing to unpack .../03-libglib2.0-0t64_2.82.2-3_arm64.deb ... 81s Unpacking libglib2.0-0t64:arm64 (2.82.2-3) over (2.82.1-0ubuntu1) ... 81s Preparing to unpack .../04-libgirepository-1.0-1_1.82.0-2_arm64.deb ... 81s Unpacking libgirepository-1.0-1:arm64 (1.82.0-2) over (1.80.1-4) ... 81s Preparing to unpack .../05-libglib2.0-data_2.82.2-3_all.deb ... 81s Unpacking libglib2.0-data (2.82.2-3) over (2.82.1-0ubuntu1) ... 82s Preparing to unpack .../06-python3-dbus_1.3.2-5build4_arm64.deb ... 82s Unpacking python3-dbus (1.3.2-5build4) over (1.3.2-5build3) ... 82s Preparing to unpack .../07-python3-gi_3.50.0-3build1_arm64.deb ... 82s Unpacking python3-gi (3.50.0-3build1) over (3.50.0-3) ... 82s Preparing to unpack .../08-python3-yaml_6.0.2-1build1_arm64.deb ... 82s Unpacking python3-yaml (6.0.2-1build1) over (6.0.2-1) ... 82s Preparing to unpack .../09-vim-tiny_2%3a9.1.0861-1ubuntu1_arm64.deb ... 82s Unpacking vim-tiny (2:9.1.0861-1ubuntu1) over (2:9.1.0777-1ubuntu1) ... 82s Preparing to unpack .../10-vim-common_2%3a9.1.0861-1ubuntu1_all.deb ... 82s Unpacking vim-common (2:9.1.0861-1ubuntu1) over (2:9.1.0777-1ubuntu1) ... 82s Preparing to unpack .../11-xxd_2%3a9.1.0861-1ubuntu1_arm64.deb ... 82s Unpacking xxd (2:9.1.0861-1ubuntu1) over (2:9.1.0777-1ubuntu1) ... 82s Preparing to unpack .../12-libplymouth5_24.004.60-2ubuntu3_arm64.deb ... 82s Unpacking libplymouth5:arm64 (24.004.60-2ubuntu3) over (24.004.60-1ubuntu11) ... 82s Preparing to unpack .../13-plymouth-theme-ubuntu-text_24.004.60-2ubuntu3_arm64.deb ... 82s Unpacking plymouth-theme-ubuntu-text (24.004.60-2ubuntu3) over (24.004.60-1ubuntu11) ... 83s Preparing to unpack .../14-plymouth_24.004.60-2ubuntu3_arm64.deb ... 83s Unpacking plymouth (24.004.60-2ubuntu3) over (24.004.60-1ubuntu11) ... 83s Preparing to unpack .../15-xz-utils_5.6.3-1_arm64.deb ... 83s Unpacking xz-utils (5.6.3-1) over (5.6.2-2) ... 83s Preparing to unpack .../16-bpftrace_0.21.2-2ubuntu3_arm64.deb ... 83s Unpacking bpftrace (0.21.2-2ubuntu3) over (0.21.2-2ubuntu2) ... 83s Preparing to unpack .../17-curl_8.9.1-2ubuntu3_arm64.deb ... 83s Unpacking curl (8.9.1-2ubuntu3) over (8.9.1-2ubuntu2) ... 83s Preparing to unpack .../18-libcurl4t64_8.9.1-2ubuntu3_arm64.deb ... 83s Unpacking libcurl4t64:arm64 (8.9.1-2ubuntu3) over (8.9.1-2ubuntu2) ... 83s Preparing to unpack .../19-dracut-install_105-2ubuntu2_arm64.deb ... 83s Unpacking dracut-install (105-2ubuntu2) over (105-1ubuntu1) ... 83s Preparing to unpack .../20-fwupd-signed_1.55+1.7-1_arm64.deb ... 83s Unpacking fwupd-signed (1.55+1.7-1) over (1.54+1.6-1build1) ... 83s Preparing to unpack .../21-libcurl3t64-gnutls_8.9.1-2ubuntu3_arm64.deb ... 83s Unpacking libcurl3t64-gnutls:arm64 (8.9.1-2ubuntu3) over (8.9.1-2ubuntu2) ... 83s Selecting previously unselected package libsgutils2-1.48:arm64. 83s Preparing to unpack .../22-libsgutils2-1.48_1.48-0ubuntu1_arm64.deb ... 83s Unpacking libsgutils2-1.48:arm64 (1.48-0ubuntu1) ... 83s Preparing to unpack .../23-linux-base_4.10.1ubuntu1_all.deb ... 83s Unpacking linux-base (4.10.1ubuntu1) over (4.5ubuntu9) ... 84s Preparing to unpack .../24-lxd-installer_10_all.deb ... 84s Unpacking lxd-installer (10) over (9) ... 84s Preparing to unpack .../25-pinentry-curses_1.3.1-0ubuntu2_arm64.deb ... 84s Unpacking pinentry-curses (1.3.1-0ubuntu2) over (1.2.1-3ubuntu5) ... 84s Preparing to unpack .../26-python3-blinker_1.9.0-1_all.deb ... 84s Unpacking python3-blinker (1.9.0-1) over (1.8.2-1) ... 84s Preparing to unpack .../27-python3-rpds-py_0.21.0-2ubuntu1_arm64.deb ... 84s Unpacking python3-rpds-py (0.21.0-2ubuntu1) over (0.20.0-0ubuntu3) ... 84s Preparing to unpack .../28-python3-jsonschema-specifications_2023.12.1-2_all.deb ... 84s Unpacking python3-jsonschema-specifications (2023.12.1-2) over (2023.12.1-1ubuntu1) ... 84s Preparing to unpack .../29-sg3-utils_1.48-0ubuntu1_arm64.deb ... 84s Unpacking sg3-utils (1.48-0ubuntu1) over (1.46-3ubuntu5) ... 84s Preparing to unpack .../30-sg3-utils-udev_1.48-0ubuntu1_all.deb ... 84s Unpacking sg3-utils-udev (1.48-0ubuntu1) over (1.46-3ubuntu5) ... 84s Setting up pinentry-curses (1.3.1-0ubuntu2) ... 84s Setting up distro-info (1.12) ... 84s Setting up linux-base (4.10.1ubuntu1) ... 85s Setting up init (1.67ubuntu1) ... 85s Setting up libcurl4t64:arm64 (8.9.1-2ubuntu3) ... 85s Setting up bpftrace (0.21.2-2ubuntu3) ... 85s Setting up openssh-client (1:9.9p1-3ubuntu2) ... 85s Setting up libcurl3t64-gnutls:arm64 (8.9.1-2ubuntu3) ... 85s Setting up fwupd-signed (1.55+1.7-1) ... 85s Setting up libsgutils2-1.48:arm64 (1.48-0ubuntu1) ... 85s Setting up debconf-i18n (1.5.87ubuntu1) ... 85s Setting up xxd (2:9.1.0861-1ubuntu1) ... 85s Setting up libglib2.0-0t64:arm64 (2.82.2-3) ... 85s No schema files found: doing nothing. 85s Setting up libglib2.0-data (2.82.2-3) ... 85s Setting up vim-common (2:9.1.0861-1ubuntu1) ... 85s Setting up xz-utils (5.6.3-1) ... 85s Setting up gir1.2-glib-2.0:arm64 (2.82.2-3) ... 85s Setting up lxd-installer (10) ... 85s Setting up dracut-install (105-2ubuntu2) ... 85s Setting up libplymouth5:arm64 (24.004.60-2ubuntu3) ... 85s Setting up libgirepository-1.0-1:arm64 (1.82.0-2) ... 85s Setting up curl (8.9.1-2ubuntu3) ... 85s Setting up libpython3-stdlib:arm64 (3.12.7-1) ... 85s Setting up sg3-utils (1.48-0ubuntu1) ... 85s Setting up openssh-sftp-server (1:9.9p1-3ubuntu2) ... 85s Setting up openssh-server (1:9.9p1-3ubuntu2) ... 85s Installing new version of config file /etc/ssh/moduli ... 85s Replacing config file /etc/ssh/sshd_config with new version 87s Setting up plymouth (24.004.60-2ubuntu3) ... 87s update-initramfs: Generating /boot/initrd.img-6.11.0-8-generic 87s W: No lz4 in /usr/bin:/sbin:/bin, using gzip 111s flash-kernel: deferring update (trigger activated) 111s update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults 111s update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults 111s Setting up python3 (3.12.7-1) ... 112s Setting up vim-tiny (2:9.1.0861-1ubuntu1) ... 112s Setting up sg3-utils-udev (1.48-0ubuntu1) ... 112s update-initramfs: deferring update (trigger activated) 112s Setting up plymouth-theme-ubuntu-text (24.004.60-2ubuntu3) ... 112s update-initramfs: deferring update (trigger activated) 112s Setting up gir1.2-girepository-2.0:arm64 (1.82.0-2) ... 112s Setting up python3-gi (3.50.0-3build1) ... 112s Setting up python3-rpds-py (0.21.0-2ubuntu1) ... 113s Setting up python3-jsonschema-specifications (2023.12.1-2) ... 113s Setting up python3-blinker (1.9.0-1) ... 113s Setting up python3-dbus (1.3.2-5build4) ... 113s Setting up python3-debconf (1.5.87ubuntu1) ... 113s Setting up python3-yaml (6.0.2-1build1) ... 114s Processing triggers for man-db (2.13.0-1) ... 116s Processing triggers for debianutils (5.21) ... 116s Processing triggers for install-info (7.1.1-1) ... 116s Processing triggers for initramfs-tools (0.142ubuntu35) ... 116s update-initramfs: Generating /boot/initrd.img-6.11.0-8-generic 116s W: No lz4 in /usr/bin:/sbin:/bin, using gzip 140s System running in EFI mode, skipping. 140s Processing triggers for libc-bin (2.40-1ubuntu3) ... 141s Processing triggers for ufw (0.36.2-8) ... 141s Processing triggers for flash-kernel (3.107ubuntu13) ... 141s System running in EFI mode, skipping. 141s Reading package lists... 142s Building dependency tree... 142s Reading state information... 143s The following packages will be REMOVED: 143s libsgutils2-1.46-2* 143s 0 upgraded, 0 newly installed, 1 to remove and 0 not upgraded. 143s After this operation, 314 kB disk space will be freed. 143s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80037 files and directories currently installed.) 143s Removing libsgutils2-1.46-2:arm64 (1.46-3ubuntu5) ... 144s Processing triggers for libc-bin (2.40-1ubuntu3) ... 144s Hit:1 http://ftpmaster.internal/ubuntu plucky-proposed InRelease 144s Hit:2 http://ftpmaster.internal/ubuntu plucky InRelease 144s Hit:3 http://ftpmaster.internal/ubuntu plucky-updates InRelease 144s Hit:4 http://ftpmaster.internal/ubuntu plucky-security InRelease 146s Reading package lists... 146s Reading package lists... 146s Building dependency tree... 146s Reading state information... 147s Calculating upgrade... 148s 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 148s Reading package lists... 148s Building dependency tree... 148s Reading state information... 149s 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 149s autopkgtest [00:20:00]: rebooting testbed after setup commands that affected boot 153s autopkgtest-virt-ssh: WARNING: ssh connection failed. Retrying in 3 seconds... 175s autopkgtest [00:20:26]: testbed running kernel: Linux 6.11.0-8-generic #8-Ubuntu SMP PREEMPT_DYNAMIC Mon Sep 16 14:19:41 UTC 2024 178s autopkgtest [00:20:29]: @@@@@@@@@@@@@@@@@@@@ apt-source dask.distributed 181s Get:1 http://ftpmaster.internal/ubuntu plucky/universe dask.distributed 2024.5.2+ds.1-8 (dsc) [3390 B] 181s Get:2 http://ftpmaster.internal/ubuntu plucky/universe dask.distributed 2024.5.2+ds.1-8 (tar) [2131 kB] 181s Get:3 http://ftpmaster.internal/ubuntu plucky/universe dask.distributed 2024.5.2+ds.1-8 (diff) [2041 kB] 182s gpgv: Signature made Tue Nov 12 23:11:00 2024 UTC 182s gpgv: using RSA key D54C3BFAFFB042DE382DA5D741CE7F0B9F1B8B32 182s gpgv: Can't check signature: No public key 182s dpkg-source: warning: cannot verify inline signature for ./dask.distributed_2024.5.2+ds.1-8.dsc: no acceptable signature found 182s autopkgtest [00:20:33]: testing package dask.distributed version 2024.5.2+ds.1-8 183s autopkgtest [00:20:34]: build not needed 184s autopkgtest [00:20:35]: test pytest: preparing testbed 185s Reading package lists... 185s Building dependency tree... 185s Reading state information... 186s Starting pkgProblemResolver with broken count: 0 186s Starting 2 pkgProblemResolver with broken count: 0 186s Done 187s The following additional packages will be installed: 187s blt fontconfig-config fonts-dejavu-core fonts-dejavu-mono fonts-font-awesome 187s fonts-glyphicons-halflings fonts-lato fonts-lyx fonts-mathjax gdb libaec0 187s libargon2-1 libbabeltrace1 libblas3 libcares2 libdebuginfod-common 187s libdebuginfod1t64 libdeflate0 libfontconfig1 libgfortran5 libgomp1 187s libgraphite2-3 libharfbuzz0b libhdf5-103-1t64 libhdf5-hl-100t64 187s libimagequant0 libjbig0 libjpeg-turbo8 libjpeg8 libjs-bootstrap libjs-jquery 187s libjs-jquery-ui libjs-mathjax libjs-sphinxdoc libjs-sprintf-js 187s libjs-underscore liblapack3 liblbfgsb0 liblcms2-2 liblerc4 liblzf1 187s libnetcdf19t64 libnode115 libnorm1t64 libopenjp2-7 libpgm-5.3-0t64 187s libpython3.13-minimal libpython3.13-stdlib libqhull-r8.0 libraqm0 187s libsharpyuv0 libsodium23 libsource-highlight-common libsource-highlight4t64 187s libsz2 libtcl8.6 libtiff6 libtk8.6 libwebp7 libwebpdemux2 libwebpmux3 187s libxft2 libxrender1 libxslt1.1 libxss1 libzmq5 node-acorn node-argparse 187s node-balanced-match node-brace-expansion node-cjs-module-lexer node-esprima 187s node-js-yaml node-minimatch node-sprintf-js node-undici node-xtend nodejs 187s python-dask-doc python-distributed-doc python-fsspec-doc 187s python-matplotlib-data python-numpy-doc python-pandas-doc 187s python-tinycss2-common python3-aiohttp python3-aiosignal python3-all 187s python3-anyio python3-appdirs python3-argon2 python3-arrow python3-asttokens 187s python3-async-timeout python3-bcrypt python3-bleach python3-brotli 187s python3-bs4 python3-cftime python3-click python3-cloudpickle 187s python3-colorama python3-comm python3-contourpy python3-coverage 187s python3-cycler python3-dask python3-dateutil python3-debugpy 187s python3-decorator python3-defusedxml python3-dill python3-distributed 187s python3-doc python3-executing python3-fastjsonschema python3-fonttools 187s python3-fqdn python3-frozenlist python3-fs python3-fsspec python3-h5py 187s python3-h5py-serial python3-html5lib python3-iniconfig python3-ipykernel 187s python3-ipython python3-isoduration python3-jedi python3-joblib 187s python3-jupyter-client python3-jupyter-core python3-jupyter-events 187s python3-jupyter-server python3-jupyter-server-terminals 187s python3-jupyterlab-pygments python3-kiwisolver python3-locket python3-lxml 187s python3-lz4 python3-matplotlib python3-matplotlib-inline python3-mistune 187s python3-mpmath python3-msgpack python3-multidict python3-nacl 187s python3-nbclient python3-nbconvert python3-nbformat python3-nest-asyncio 187s python3-netcdf4 python3-numpy python3-overrides python3-packaging 187s python3-pandas python3-pandas-lib python3-pandocfilters python3-paramiko 187s python3-parso python3-partd python3-pexpect python3-pil python3-pil.imagetk 187s python3-platformdirs python3-pluggy python3-prometheus-client 187s python3-prompt-toolkit python3-psutil python3-ptyprocess python3-pure-eval 187s python3-py python3-pytest python3-pytest-rerunfailures 187s python3-pytest-timeout python3-pythonjsonlogger python3-rfc3339-validator 187s python3-rfc3986-validator python3-scipy python3-send2trash python3-six 187s python3-sklearn python3-sklearn-lib python3-sniffio python3-sortedcontainers 187s python3-soupsieve python3-stack-data python3-sympy python3-tblib 187s python3-terminado python3-threadpoolctl python3-tinycss2 python3-tk 187s python3-toolz python3-tornado python3-traitlets python3-typeshed python3-tz 187s python3-ufolib2 python3-uritemplate python3-wcwidth python3-webcolors 187s python3-webencodings python3-websocket python3-yarl python3-zict python3-zmq 187s python3.12-doc python3.12-tk python3.13 python3.13-minimal python3.13-tk 187s sass-stylesheets-bulma sphinx-rtd-theme-common tk8.6-blt2.5 tzdata-legacy 187s unicode-data x11-common 187s Suggested packages: 187s blt-demo gdb-doc gdbserver libjs-jquery-ui-docs fonts-mathjax-extras 187s fonts-stix libjs-mathjax-doc libjs-angularjs liblcms2-utils tcl8.6 tk8.6 187s javascript-common npm node-corepack python-imageio-doc python-pytest-doc 187s python-scipy-doc python-skimage-doc python-argon2-doc python-arrow-doc 187s python-bleach-doc python-coverage-doc python-cycler-doc ipython 187s python3-blosc python3-boto3 python3-graphviz python3-skimage 187s python3-sqlalchemy python3-tables python3-objgraph python3-examples 187s python-fastjsonschema-doc python-h5py-doc python3-genshi python-ipython-doc 187s python-joblib-doc python-jupyter-client-doc python3-pip 187s python-jupyter-events-doc python-jupyter-server-doc python-lxml-doc 187s cm-super-minimal dvipng ffmpeg fonts-staypuft ghostscript gir1.2-gtk-3.0 187s inkscape ipython3 librsvg2-common python-matplotlib-doc python3-cairocffi 187s python3-gi-cairo python3-gobject python3-pyqt5 python3-sip 187s texlive-extra-utils texlive-latex-extra python-mpmath-doc python3-gmpy2 187s python-nacl-doc python-nbconvert-doc texlive-fonts-recommended 187s texlive-plain-generic texlive-xetex gcc gfortran python3-dev 187s python3-statsmodels python3-gssapi python3-invoke python-pexpect-doc 187s python-pil-doc subversion python3-dap python-sklearn-doc 187s python-sortedcontainers-doc texlive-fonts-extra python-sympy-doc 187s python-terminado-doc python-tinycss2-doc tix python3-tk-dbg python-toolz-doc 187s python3-pycurl python-tornado-doc python3-twisted python-traitlets-doc 187s python3.13-venv python3.13-doc binfmt-support 187s Recommended packages: 187s libc-dbg javascript-common nodejs-doc python3-aiodns git python3-dropbox 187s python3-fusepy python3-libarchive-c python3-pygit2 python3-simplejson 187s python3-cssselect pandoc python3-bottleneck python3-numexpr python3-odf 187s python3-openpyxl python3-tables python3-blosc python3-olefile g++ 187s | c++-compiler isympy-common 188s The following NEW packages will be installed: 188s autopkgtest-satdep blt fontconfig-config fonts-dejavu-core fonts-dejavu-mono 188s fonts-font-awesome fonts-glyphicons-halflings fonts-lato fonts-lyx 188s fonts-mathjax gdb libaec0 libargon2-1 libbabeltrace1 libblas3 libcares2 188s libdebuginfod-common libdebuginfod1t64 libdeflate0 libfontconfig1 188s libgfortran5 libgomp1 libgraphite2-3 libharfbuzz0b libhdf5-103-1t64 188s libhdf5-hl-100t64 libimagequant0 libjbig0 libjpeg-turbo8 libjpeg8 188s libjs-bootstrap libjs-jquery libjs-jquery-ui libjs-mathjax libjs-sphinxdoc 188s libjs-sprintf-js libjs-underscore liblapack3 liblbfgsb0 liblcms2-2 liblerc4 188s liblzf1 libnetcdf19t64 libnode115 libnorm1t64 libopenjp2-7 libpgm-5.3-0t64 188s libpython3.13-minimal libpython3.13-stdlib libqhull-r8.0 libraqm0 188s libsharpyuv0 libsodium23 libsource-highlight-common libsource-highlight4t64 188s libsz2 libtcl8.6 libtiff6 libtk8.6 libwebp7 libwebpdemux2 libwebpmux3 188s libxft2 libxrender1 libxslt1.1 libxss1 libzmq5 node-acorn node-argparse 188s node-balanced-match node-brace-expansion node-cjs-module-lexer node-esprima 188s node-js-yaml node-minimatch node-sprintf-js node-undici node-xtend nodejs 188s python-dask-doc python-distributed-doc python-fsspec-doc 188s python-matplotlib-data python-numpy-doc python-pandas-doc 188s python-tinycss2-common python3-aiohttp python3-aiosignal python3-all 188s python3-anyio python3-appdirs python3-argon2 python3-arrow python3-asttokens 188s python3-async-timeout python3-bcrypt python3-bleach python3-brotli 188s python3-bs4 python3-cftime python3-click python3-cloudpickle 188s python3-colorama python3-comm python3-contourpy python3-coverage 188s python3-cycler python3-dask python3-dateutil python3-debugpy 188s python3-decorator python3-defusedxml python3-dill python3-distributed 188s python3-doc python3-executing python3-fastjsonschema python3-fonttools 188s python3-fqdn python3-frozenlist python3-fs python3-fsspec python3-h5py 188s python3-h5py-serial python3-html5lib python3-iniconfig python3-ipykernel 188s python3-ipython python3-isoduration python3-jedi python3-joblib 188s python3-jupyter-client python3-jupyter-core python3-jupyter-events 188s python3-jupyter-server python3-jupyter-server-terminals 188s python3-jupyterlab-pygments python3-kiwisolver python3-locket python3-lxml 188s python3-lz4 python3-matplotlib python3-matplotlib-inline python3-mistune 188s python3-mpmath python3-msgpack python3-multidict python3-nacl 188s python3-nbclient python3-nbconvert python3-nbformat python3-nest-asyncio 188s python3-netcdf4 python3-numpy python3-overrides python3-packaging 188s python3-pandas python3-pandas-lib python3-pandocfilters python3-paramiko 188s python3-parso python3-partd python3-pexpect python3-pil python3-pil.imagetk 188s python3-platformdirs python3-pluggy python3-prometheus-client 188s python3-prompt-toolkit python3-psutil python3-ptyprocess python3-pure-eval 188s python3-py python3-pytest python3-pytest-rerunfailures 188s python3-pytest-timeout python3-pythonjsonlogger python3-rfc3339-validator 188s python3-rfc3986-validator python3-scipy python3-send2trash python3-six 188s python3-sklearn python3-sklearn-lib python3-sniffio python3-sortedcontainers 188s python3-soupsieve python3-stack-data python3-sympy python3-tblib 188s python3-terminado python3-threadpoolctl python3-tinycss2 python3-tk 188s python3-toolz python3-tornado python3-traitlets python3-typeshed python3-tz 188s python3-ufolib2 python3-uritemplate python3-wcwidth python3-webcolors 188s python3-webencodings python3-websocket python3-yarl python3-zict python3-zmq 188s python3.12-doc python3.12-tk python3.13 python3.13-minimal python3.13-tk 188s sass-stylesheets-bulma sphinx-rtd-theme-common tk8.6-blt2.5 tzdata-legacy 188s unicode-data x11-common 188s 0 upgraded, 219 newly installed, 0 to remove and 0 not upgraded. 188s Need to get 172 MB/172 MB of archives. 188s After this operation, 1134 MB of additional disk space will be used. 188s Get:1 /tmp/autopkgtest.Vx887U/1-autopkgtest-satdep.deb autopkgtest-satdep arm64 0 [900 B] 188s Get:2 http://ftpmaster.internal/ubuntu plucky/main arm64 fonts-lato all 2.015-1 [2781 kB] 188s Get:3 http://ftpmaster.internal/ubuntu plucky/main arm64 libdebuginfod-common all 0.192-4 [15.4 kB] 188s Get:4 http://ftpmaster.internal/ubuntu plucky/main arm64 libpython3.13-minimal arm64 3.13.0-2 [877 kB] 188s Get:5 http://ftpmaster.internal/ubuntu plucky/main arm64 python3.13-minimal arm64 3.13.0-2 [2100 kB] 189s Get:6 http://ftpmaster.internal/ubuntu plucky/main arm64 libtcl8.6 arm64 8.6.15+dfsg-2 [987 kB] 189s Get:7 http://ftpmaster.internal/ubuntu plucky/main arm64 fonts-dejavu-mono all 2.37-8 [502 kB] 189s Get:8 http://ftpmaster.internal/ubuntu plucky/main arm64 fonts-dejavu-core all 2.37-8 [835 kB] 189s Get:9 http://ftpmaster.internal/ubuntu plucky/main arm64 fontconfig-config arm64 2.15.0-1.1ubuntu2 [37.4 kB] 189s Get:10 http://ftpmaster.internal/ubuntu plucky/main arm64 libfontconfig1 arm64 2.15.0-1.1ubuntu2 [142 kB] 189s Get:11 http://ftpmaster.internal/ubuntu plucky/main arm64 libxrender1 arm64 1:0.9.10-1.1build1 [18.8 kB] 189s Get:12 http://ftpmaster.internal/ubuntu plucky/main arm64 libxft2 arm64 2.3.6-1build1 [44.1 kB] 189s Get:13 http://ftpmaster.internal/ubuntu plucky/main arm64 x11-common all 1:7.7+23ubuntu3 [21.7 kB] 189s Get:14 http://ftpmaster.internal/ubuntu plucky/main arm64 libxss1 arm64 1:1.2.3-1build3 [7244 B] 189s Get:15 http://ftpmaster.internal/ubuntu plucky/main arm64 libtk8.6 arm64 8.6.15-1 [774 kB] 189s Get:16 http://ftpmaster.internal/ubuntu plucky/main arm64 tk8.6-blt2.5 arm64 2.5.3+dfsg-7build1 [618 kB] 189s Get:17 http://ftpmaster.internal/ubuntu plucky/main arm64 blt arm64 2.5.3+dfsg-7build1 [4840 B] 189s Get:18 http://ftpmaster.internal/ubuntu plucky/main arm64 fonts-font-awesome all 5.0.10+really4.7.0~dfsg-4.1 [516 kB] 189s Get:19 http://ftpmaster.internal/ubuntu plucky/universe arm64 fonts-glyphicons-halflings all 1.009~3.4.1+dfsg-3 [118 kB] 189s Get:20 http://ftpmaster.internal/ubuntu plucky/universe arm64 fonts-lyx all 2.4.2.1-1 [171 kB] 189s Get:21 http://ftpmaster.internal/ubuntu plucky/main arm64 fonts-mathjax all 2.7.9+dfsg-1 [2208 kB] 189s Get:22 http://ftpmaster.internal/ubuntu plucky/main arm64 libbabeltrace1 arm64 1.5.11-4build1 [159 kB] 189s Get:23 http://ftpmaster.internal/ubuntu plucky/main arm64 libdebuginfod1t64 arm64 0.192-4 [20.8 kB] 189s Get:24 http://ftpmaster.internal/ubuntu plucky/main arm64 libsource-highlight-common all 3.1.9-4.3build1 [64.2 kB] 189s Get:25 http://ftpmaster.internal/ubuntu plucky/main arm64 libsource-highlight4t64 arm64 3.1.9-4.3build1 [243 kB] 189s Get:26 http://ftpmaster.internal/ubuntu plucky/main arm64 gdb arm64 15.1-1ubuntu2 [4550 kB] 189s Get:27 http://ftpmaster.internal/ubuntu plucky/universe arm64 libaec0 arm64 1.1.3-1 [22.0 kB] 189s Get:28 http://ftpmaster.internal/ubuntu plucky/main arm64 libargon2-1 arm64 0~20190702+dfsg-4build1 [20.5 kB] 189s Get:29 http://ftpmaster.internal/ubuntu plucky/main arm64 libblas3 arm64 3.12.0-4 [152 kB] 189s Get:30 http://ftpmaster.internal/ubuntu plucky/main arm64 libcares2 arm64 1.34.2-1 [95.2 kB] 189s Get:31 http://ftpmaster.internal/ubuntu plucky/main arm64 libdeflate0 arm64 1.22-1 [46.2 kB] 189s Get:32 http://ftpmaster.internal/ubuntu plucky/main arm64 libgfortran5 arm64 14.2.0-8ubuntu1 [438 kB] 189s Get:33 http://ftpmaster.internal/ubuntu plucky/main arm64 libgomp1 arm64 14.2.0-8ubuntu1 [145 kB] 189s Get:34 http://ftpmaster.internal/ubuntu plucky/main arm64 libgraphite2-3 arm64 1.3.14-2ubuntu1 [70.6 kB] 189s Get:35 http://ftpmaster.internal/ubuntu plucky/main arm64 libharfbuzz0b arm64 10.0.1-1 [487 kB] 189s Get:36 http://ftpmaster.internal/ubuntu plucky/universe arm64 libsz2 arm64 1.1.3-1 [5254 B] 189s Get:37 http://ftpmaster.internal/ubuntu plucky/universe arm64 libhdf5-103-1t64 arm64 1.10.10+repack-4ubuntu3 [1207 kB] 189s Get:38 http://ftpmaster.internal/ubuntu plucky/universe arm64 libhdf5-hl-100t64 arm64 1.10.10+repack-4ubuntu3 [56.9 kB] 189s Get:39 http://ftpmaster.internal/ubuntu plucky/main arm64 libimagequant0 arm64 2.18.0-1build1 [37.1 kB] 189s Get:40 http://ftpmaster.internal/ubuntu plucky/main arm64 libjpeg-turbo8 arm64 2.1.5-3ubuntu2 [165 kB] 189s Get:41 http://ftpmaster.internal/ubuntu plucky/main arm64 libjpeg8 arm64 8c-2ubuntu11 [2148 B] 189s Get:42 http://ftpmaster.internal/ubuntu plucky/universe arm64 libjs-bootstrap all 3.4.1+dfsg-3 [129 kB] 189s Get:43 http://ftpmaster.internal/ubuntu plucky/main arm64 libjs-jquery all 3.6.1+dfsg+~3.5.14-1 [328 kB] 189s Get:44 http://ftpmaster.internal/ubuntu plucky/universe arm64 libjs-jquery-ui all 1.13.2+dfsg-1 [252 kB] 189s Get:45 http://ftpmaster.internal/ubuntu plucky/main arm64 libjs-underscore all 1.13.4~dfsg+~1.11.4-3 [118 kB] 189s Get:46 http://ftpmaster.internal/ubuntu plucky/main arm64 libjs-sphinxdoc all 7.4.7-4 [158 kB] 189s Get:47 http://ftpmaster.internal/ubuntu plucky/universe arm64 libjs-sprintf-js all 1.1.2+ds1+~1.1.2-1 [12.8 kB] 189s Get:48 http://ftpmaster.internal/ubuntu plucky/main arm64 liblapack3 arm64 3.12.0-4 [2305 kB] 190s Get:49 http://ftpmaster.internal/ubuntu plucky/universe arm64 liblbfgsb0 arm64 3.0+dfsg.4-1build1 [27.7 kB] 190s Get:50 http://ftpmaster.internal/ubuntu plucky/main arm64 liblcms2-2 arm64 2.16-2 [170 kB] 190s Get:51 http://ftpmaster.internal/ubuntu plucky/main arm64 liblerc4 arm64 4.0.0+ds-5ubuntu1 [167 kB] 190s Get:52 http://ftpmaster.internal/ubuntu plucky/universe arm64 liblzf1 arm64 3.6-4 [7426 B] 190s Get:53 http://ftpmaster.internal/ubuntu plucky/universe arm64 libnetcdf19t64 arm64 1:4.9.2-6ubuntu1 [466 kB] 190s Get:54 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-xtend all 4.0.2-3 [3902 B] 190s Get:55 http://ftpmaster.internal/ubuntu plucky/universe arm64 nodejs arm64 20.18.0+dfsg-2 [336 kB] 190s Get:56 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-acorn all 8.8.1+ds+~cs25.17.7-2 [115 kB] 190s Get:57 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-cjs-module-lexer all 1.2.3+dfsg-1 [32.1 kB] 190s Get:58 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-balanced-match all 2.0.0-1 [4910 B] 190s Get:59 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-brace-expansion all 2.0.1+~1.1.0-1 [8072 B] 190s Get:60 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-minimatch all 9.0.3-5 [78.2 kB] 190s Get:61 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-undici all 5.28.4+dfsg1+~cs23.12.11-2 [321 kB] 190s Get:62 http://ftpmaster.internal/ubuntu plucky/universe arm64 libnode115 arm64 20.18.0+dfsg-2 [12.8 MB] 191s Get:63 http://ftpmaster.internal/ubuntu plucky/universe arm64 libnorm1t64 arm64 1.5.9+dfsg-3.1build1 [150 kB] 191s Get:64 http://ftpmaster.internal/ubuntu plucky/universe arm64 libpgm-5.3-0t64 arm64 5.3.128~dfsg-2.1build1 [162 kB] 191s Get:65 http://ftpmaster.internal/ubuntu plucky/main arm64 libpython3.13-stdlib arm64 3.13.0-2 [2073 kB] 191s Get:66 http://ftpmaster.internal/ubuntu plucky/universe arm64 libqhull-r8.0 arm64 2020.2-6build1 [189 kB] 191s Get:67 http://ftpmaster.internal/ubuntu plucky/main arm64 libraqm0 arm64 0.10.1-1build1 [14.7 kB] 191s Get:68 http://ftpmaster.internal/ubuntu plucky/main arm64 libsharpyuv0 arm64 1.4.0-0.1 [16.3 kB] 191s Get:69 http://ftpmaster.internal/ubuntu plucky/main arm64 libsodium23 arm64 1.0.18-1build3 [119 kB] 191s Get:70 http://ftpmaster.internal/ubuntu plucky/main arm64 libjbig0 arm64 2.1-6.1ubuntu2 [29.3 kB] 191s Get:71 http://ftpmaster.internal/ubuntu plucky/main arm64 libwebp7 arm64 1.4.0-0.1 [192 kB] 191s Get:72 http://ftpmaster.internal/ubuntu plucky/main arm64 libtiff6 arm64 4.5.1+git230720-4ubuntu4 [193 kB] 191s Get:73 http://ftpmaster.internal/ubuntu plucky/main arm64 libwebpdemux2 arm64 1.4.0-0.1 [12.3 kB] 191s Get:74 http://ftpmaster.internal/ubuntu plucky/main arm64 libwebpmux3 arm64 1.4.0-0.1 [25.1 kB] 191s Get:75 http://ftpmaster.internal/ubuntu plucky/main arm64 libxslt1.1 arm64 1.1.39-0exp1ubuntu1 [167 kB] 191s Get:76 http://ftpmaster.internal/ubuntu plucky/universe arm64 libzmq5 arm64 4.3.5-1build2 [247 kB] 191s Get:77 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-esprima all 4.0.1+ds+~4.0.3-2 [69.3 kB] 191s Get:78 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-sprintf-js all 1.1.2+ds1+~1.1.2-1 [3916 B] 191s Get:79 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-argparse all 2.0.1-2 [33.2 kB] 191s Get:80 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-js-yaml all 4.1.0+dfsg+~4.0.5-7 [61.9 kB] 191s Get:81 http://ftpmaster.internal/ubuntu plucky/main arm64 libjs-mathjax all 2.7.9+dfsg-1 [5665 kB] 191s Get:82 http://ftpmaster.internal/ubuntu plucky/universe arm64 python-dask-doc all 2024.5.2+dfsg-1 [10.8 MB] 192s Get:83 http://ftpmaster.internal/ubuntu plucky/main arm64 sphinx-rtd-theme-common all 3.0.2+dfsg-1 [1014 kB] 192s Get:84 http://ftpmaster.internal/ubuntu plucky/universe arm64 python-fsspec-doc all 2024.9.0-1 [313 kB] 192s Get:85 http://ftpmaster.internal/ubuntu plucky/main arm64 python-numpy-doc all 1:1.26.4+ds-11ubuntu1 [5481 kB] 192s Get:86 http://ftpmaster.internal/ubuntu plucky/universe arm64 python-pandas-doc all 2.2.3+dfsg-5ubuntu1 [9117 kB] 193s Get:87 http://ftpmaster.internal/ubuntu plucky/main arm64 python3.12-doc all 3.12.7-3 [12.4 MB] 193s Get:88 http://ftpmaster.internal/ubuntu plucky-proposed/main arm64 python3-doc all 3.12.7-1 [10.3 kB] 193s Get:89 http://ftpmaster.internal/ubuntu plucky/universe arm64 sass-stylesheets-bulma all 0.9.4~ds-1 [113 kB] 193s Get:90 http://ftpmaster.internal/ubuntu plucky/universe arm64 python-distributed-doc all 2024.5.2+ds.1-8 [3143 kB] 193s Get:91 http://ftpmaster.internal/ubuntu plucky/universe arm64 python-matplotlib-data all 3.8.3-3ubuntu1 [2928 kB] 193s Get:92 http://ftpmaster.internal/ubuntu plucky/universe arm64 python-tinycss2-common all 1.4.0-1 [47.0 kB] 193s Get:93 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-multidict arm64 6.1.0-1build1 [38.3 kB] 193s Get:94 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-yarl arm64 1.9.4-1 [68.2 kB] 193s Get:95 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-async-timeout all 4.0.3-1 [6412 B] 193s Get:96 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-frozenlist arm64 1.5.0-1build1 [59.0 kB] 193s Get:97 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-aiosignal all 1.3.1-1 [5172 B] 193s Get:98 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-aiohttp arm64 3.9.5-1 [278 kB] 193s Get:99 http://ftpmaster.internal/ubuntu plucky/main arm64 python3.13 arm64 3.13.0-2 [719 kB] 193s Get:100 http://ftpmaster.internal/ubuntu plucky-proposed/main arm64 python3-all arm64 3.12.7-1 [890 B] 193s Get:101 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-sniffio all 1.3.1-1 [7262 B] 193s Get:102 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-anyio all 4.6.2-4 [60.0 kB] 194s Get:103 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-appdirs all 1.4.4-4 [10.9 kB] 194s Get:104 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-argon2 arm64 21.1.0-2build1 [21.4 kB] 194s Get:105 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-dateutil all 2.9.0-3 [80.2 kB] 194s Get:106 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-arrow all 1.3.0-1.1ubuntu1 [56.1 kB] 194s Get:107 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-asttokens all 2.4.1-2 [20.8 kB] 194s Get:108 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-webencodings all 0.5.1-5 [11.5 kB] 194s Get:109 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-html5lib all 1.2-1 [90.8 kB] 194s Get:110 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-bleach all 6.2.0-1 [43.9 kB] 194s Get:111 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-brotli arm64 1.1.0-2build3 [342 kB] 194s Get:112 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-soupsieve all 2.6-1 [33.0 kB] 194s Get:113 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-bs4 all 4.12.3-3 [109 kB] 194s Get:114 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-numpy arm64 1:1.26.4+ds-11ubuntu1 [4149 kB] 194s Get:115 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-cftime arm64 1.6.4-1build1 [290 kB] 194s Get:116 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-colorama all 0.4.6-4 [32.1 kB] 194s Get:117 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-click all 8.1.7-2 [79.5 kB] 194s Get:118 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-cloudpickle all 3.0.0-2 [21.5 kB] 194s Get:119 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-traitlets all 5.14.3+really5.14.3-1 [71.5 kB] 194s Get:120 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-comm all 0.2.1-1 [7016 B] 194s Get:121 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-contourpy arm64 1.3.0-2build1 [220 kB] 194s Get:122 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-coverage arm64 7.4.4+dfsg1-0ubuntu3 [150 kB] 194s Get:123 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-cycler all 0.12.1-1 [9716 B] 194s Get:124 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-fsspec all 2024.9.0-1 [207 kB] 194s Get:125 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-toolz all 1.0.0-1 [44.9 kB] 194s Get:126 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-packaging all 24.2-1 [51.5 kB] 194s Get:127 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-locket all 1.0.0-2 [5872 B] 194s Get:128 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-partd all 1.4.2-1 [15.7 kB] 194s Get:129 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-dask all 2024.5.2+dfsg-1 [849 kB] 194s Get:130 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-debugpy arm64 1.8.8+ds-2ubuntu1 [1054 kB] 195s Get:131 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-decorator all 5.1.1-5 [10.1 kB] 195s Get:132 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-defusedxml all 0.7.1-2 [42.0 kB] 195s Get:133 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-dill all 0.3.9-1 [84.5 kB] 195s Get:134 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-msgpack arm64 1.0.3-3build3 [106 kB] 195s Get:135 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-psutil arm64 5.9.8-2build3 [196 kB] 195s Get:136 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-sortedcontainers all 2.4.0-2 [27.6 kB] 195s Get:137 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-tblib all 3.0.0-5 [12.9 kB] 195s Get:138 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-tornado arm64 6.4.1-3 [299 kB] 195s Get:139 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-zict all 3.0.0-2ubuntu1 [30.4 kB] 195s Get:140 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-distributed all 2024.5.2+ds.1-8 [1006 kB] 195s Get:141 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-executing all 2.1.0-0.1 [24.4 kB] 195s Get:142 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-fastjsonschema all 2.20.0-1 [20.1 kB] 195s Get:143 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-tz all 2024.1-2 [31.4 kB] 195s Get:144 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-six all 1.16.0-7 [13.1 kB] 195s Get:145 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-fs all 2.4.16-4 [91.3 kB] 195s Get:146 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-lxml arm64 5.3.0-1build1 [1591 kB] 195s Get:147 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-lz4 arm64 4.0.2+dfsg-1build5 [27.5 kB] 195s Get:148 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-scipy arm64 1.13.1-5ubuntu1 [19.1 MB] 195s Get:149 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-mpmath all 1.3.0-1 [425 kB] 196s Get:150 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-sympy all 1.13.3-1 [4228 kB] 196s Get:151 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-ufolib2 all 0.16.1+dfsg1-1 [33.4 kB] 196s Get:152 http://ftpmaster.internal/ubuntu plucky/universe arm64 unicode-data all 15.1.0-1 [8878 kB] 196s Get:153 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-fonttools arm64 4.55.0-3 [1618 kB] 196s Get:154 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-fqdn all 1.5.1-2 [7688 B] 196s Get:155 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-h5py-serial arm64 3.11.0-5ubuntu1 [1064 kB] 196s Get:156 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-h5py all 3.11.0-5ubuntu1 [7974 B] 196s Get:157 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-iniconfig all 1.1.1-2 [6024 B] 196s Get:158 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-parso all 0.8.3-1 [67.2 kB] 196s Get:159 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-typeshed all 0.0~git20231111.6764465-3 [1274 kB] 196s Get:160 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-jedi all 0.19.1+ds1-1 [693 kB] 196s Get:161 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-matplotlib-inline all 0.1.6-2 [8784 B] 196s Get:162 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-wcwidth all 0.2.13+dfsg1-1 [26.3 kB] 196s Get:163 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-prompt-toolkit all 3.0.48-1 [256 kB] 196s Get:164 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pure-eval all 0.2.3-1 [11.4 kB] 196s Get:165 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-stack-data all 0.6.3-1 [22.0 kB] 196s Get:166 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-ptyprocess all 0.7.0-6 [14.8 kB] 196s Get:167 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-pexpect all 4.9-3 [48.1 kB] 196s Get:168 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-ipython all 8.29.0-1 [569 kB] 196s Get:169 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-platformdirs all 4.3.6-1 [16.8 kB] 196s Get:170 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-jupyter-core all 5.7.2-4 [28.0 kB] 196s Get:171 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-py all 1.11.0-2 [72.7 kB] 196s Get:172 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-zmq arm64 24.0.1-5build2 [347 kB] 196s Get:173 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-jupyter-client all 8.6.3-1 [78.2 kB] 196s Get:174 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-nest-asyncio all 1.5.4-1 [6256 B] 196s Get:175 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-ipykernel all 6.29.5-1 [82.5 kB] 196s Get:176 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-isoduration all 20.11.0+git20211126.ae0bd61-2 [12.5 kB] 196s Get:177 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-joblib all 1.3.2-5 [206 kB] 196s Get:178 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pythonjsonlogger all 3.1.0-1 [11.8 kB] 196s Get:179 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-rfc3339-validator all 0.1.4-2 [3930 B] 196s Get:180 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-rfc3986-validator all 0.1.1-2 [4758 B] 196s Get:181 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-uritemplate all 4.1.1-3 [9762 B] 196s Get:182 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-webcolors all 1.13-1 [13.6 kB] 196s Get:183 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-jupyter-events all 0.10.0-3 [15.5 kB] 196s Get:184 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-terminado all 0.18.1-1 [13.2 kB] 196s Get:185 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-jupyter-server-terminals all 0.5.3-2 [10.9 kB] 196s Get:186 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-jupyterlab-pygments all 0.2.2-3 [6054 B] 196s Get:187 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-mistune all 3.0.2-2 [32.9 kB] 196s Get:188 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-nbformat all 5.9.1-1 [41.2 kB] 196s Get:189 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-nbclient all 0.8.0-1 [55.6 kB] 196s Get:190 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pandocfilters all 1.5.1-1 [23.6 kB] 196s Get:191 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-tinycss2 all 1.4.0-1 [22.5 kB] 196s Get:192 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-nbconvert all 7.16.4-2 [139 kB] 196s Get:193 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-overrides all 7.7.0-2 [14.4 kB] 196s Get:194 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-prometheus-client all 0.19.0+ds1-1 [41.7 kB] 197s Get:195 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-send2trash all 1.8.3-1 [14.6 kB] 197s Get:196 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-websocket all 1.8.0-2 [38.5 kB] 197s Get:197 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-jupyter-server all 2.14.2-4 [183 kB] 197s Get:198 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-kiwisolver arm64 1.4.7-2build1 [62.0 kB] 197s Get:199 http://ftpmaster.internal/ubuntu plucky/main arm64 libopenjp2-7 arm64 2.5.0-2ubuntu1 [182 kB] 197s Get:200 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-pil arm64 10.4.0-1ubuntu2 [473 kB] 197s Get:201 http://ftpmaster.internal/ubuntu plucky/main arm64 python3.12-tk arm64 3.12.7-3 [115 kB] 197s Get:202 http://ftpmaster.internal/ubuntu plucky/main arm64 python3.13-tk arm64 3.13.0-2 [105 kB] 197s Get:203 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-tk arm64 3.12.7-1 [9752 B] 197s Get:204 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pil.imagetk arm64 10.4.0-1ubuntu2 [9590 B] 197s Get:205 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-matplotlib arm64 3.8.3-3ubuntu1 [4612 kB] 197s Get:206 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-nacl arm64 1.5.0-6 [56.1 kB] 197s Get:207 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-netcdf4 arm64 1.7.2-1build1 [798 kB] 197s Get:208 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pandas-lib arm64 2.2.3+dfsg-5ubuntu1 [6921 kB] 198s Get:209 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pandas all 2.2.3+dfsg-5ubuntu1 [3112 kB] 198s Get:210 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-bcrypt arm64 4.2.0-2.1 [237 kB] 198s Get:211 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-paramiko all 3.4.1-2ubuntu1 [146 kB] 198s Get:212 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pluggy all 1.5.0-1 [21.0 kB] 198s Get:213 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pytest all 8.3.3-1 [251 kB] 198s Get:214 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pytest-rerunfailures all 14.0-2 [13.7 kB] 198s Get:215 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pytest-timeout all 2.3.1-1 [22.1 kB] 198s Get:216 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 198s Get:217 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-sklearn-lib arm64 1.4.2+dfsg-6build1 [6350 kB] 198s Get:218 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-sklearn all 1.4.2+dfsg-6build1 [2257 kB] 198s Get:219 http://ftpmaster.internal/ubuntu plucky/main arm64 tzdata-legacy all 2024b-1ubuntu2 [99.9 kB] 199s Preconfiguring packages ... 199s Fetched 172 MB in 11s (15.9 MB/s) 200s Selecting previously unselected package fonts-lato. 200s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80032 files and directories currently installed.) 200s Preparing to unpack .../000-fonts-lato_2.015-1_all.deb ... 200s Unpacking fonts-lato (2.015-1) ... 200s Selecting previously unselected package libdebuginfod-common. 200s Preparing to unpack .../001-libdebuginfod-common_0.192-4_all.deb ... 200s Unpacking libdebuginfod-common (0.192-4) ... 200s Selecting previously unselected package libpython3.13-minimal:arm64. 200s Preparing to unpack .../002-libpython3.13-minimal_3.13.0-2_arm64.deb ... 200s Unpacking libpython3.13-minimal:arm64 (3.13.0-2) ... 200s Selecting previously unselected package python3.13-minimal. 200s Preparing to unpack .../003-python3.13-minimal_3.13.0-2_arm64.deb ... 200s Unpacking python3.13-minimal (3.13.0-2) ... 200s Selecting previously unselected package libtcl8.6:arm64. 200s Preparing to unpack .../004-libtcl8.6_8.6.15+dfsg-2_arm64.deb ... 200s Unpacking libtcl8.6:arm64 (8.6.15+dfsg-2) ... 200s Selecting previously unselected package fonts-dejavu-mono. 200s Preparing to unpack .../005-fonts-dejavu-mono_2.37-8_all.deb ... 200s Unpacking fonts-dejavu-mono (2.37-8) ... 200s Selecting previously unselected package fonts-dejavu-core. 200s Preparing to unpack .../006-fonts-dejavu-core_2.37-8_all.deb ... 200s Unpacking fonts-dejavu-core (2.37-8) ... 200s Selecting previously unselected package fontconfig-config. 200s Preparing to unpack .../007-fontconfig-config_2.15.0-1.1ubuntu2_arm64.deb ... 201s Unpacking fontconfig-config (2.15.0-1.1ubuntu2) ... 201s Selecting previously unselected package libfontconfig1:arm64. 201s Preparing to unpack .../008-libfontconfig1_2.15.0-1.1ubuntu2_arm64.deb ... 201s Unpacking libfontconfig1:arm64 (2.15.0-1.1ubuntu2) ... 201s Selecting previously unselected package libxrender1:arm64. 201s Preparing to unpack .../009-libxrender1_1%3a0.9.10-1.1build1_arm64.deb ... 201s Unpacking libxrender1:arm64 (1:0.9.10-1.1build1) ... 201s Selecting previously unselected package libxft2:arm64. 201s Preparing to unpack .../010-libxft2_2.3.6-1build1_arm64.deb ... 201s Unpacking libxft2:arm64 (2.3.6-1build1) ... 201s Selecting previously unselected package x11-common. 201s Preparing to unpack .../011-x11-common_1%3a7.7+23ubuntu3_all.deb ... 201s Unpacking x11-common (1:7.7+23ubuntu3) ... 201s Selecting previously unselected package libxss1:arm64. 201s Preparing to unpack .../012-libxss1_1%3a1.2.3-1build3_arm64.deb ... 201s Unpacking libxss1:arm64 (1:1.2.3-1build3) ... 201s Selecting previously unselected package libtk8.6:arm64. 201s Preparing to unpack .../013-libtk8.6_8.6.15-1_arm64.deb ... 201s Unpacking libtk8.6:arm64 (8.6.15-1) ... 201s Selecting previously unselected package tk8.6-blt2.5. 201s Preparing to unpack .../014-tk8.6-blt2.5_2.5.3+dfsg-7build1_arm64.deb ... 201s Unpacking tk8.6-blt2.5 (2.5.3+dfsg-7build1) ... 201s Selecting previously unselected package blt. 201s Preparing to unpack .../015-blt_2.5.3+dfsg-7build1_arm64.deb ... 201s Unpacking blt (2.5.3+dfsg-7build1) ... 201s Selecting previously unselected package fonts-font-awesome. 201s Preparing to unpack .../016-fonts-font-awesome_5.0.10+really4.7.0~dfsg-4.1_all.deb ... 201s Unpacking fonts-font-awesome (5.0.10+really4.7.0~dfsg-4.1) ... 201s Selecting previously unselected package fonts-glyphicons-halflings. 201s Preparing to unpack .../017-fonts-glyphicons-halflings_1.009~3.4.1+dfsg-3_all.deb ... 201s Unpacking fonts-glyphicons-halflings (1.009~3.4.1+dfsg-3) ... 201s Selecting previously unselected package fonts-lyx. 201s Preparing to unpack .../018-fonts-lyx_2.4.2.1-1_all.deb ... 201s Unpacking fonts-lyx (2.4.2.1-1) ... 201s Selecting previously unselected package fonts-mathjax. 202s Preparing to unpack .../019-fonts-mathjax_2.7.9+dfsg-1_all.deb ... 202s Unpacking fonts-mathjax (2.7.9+dfsg-1) ... 202s Selecting previously unselected package libbabeltrace1:arm64. 202s Preparing to unpack .../020-libbabeltrace1_1.5.11-4build1_arm64.deb ... 202s Unpacking libbabeltrace1:arm64 (1.5.11-4build1) ... 202s Selecting previously unselected package libdebuginfod1t64:arm64. 202s Preparing to unpack .../021-libdebuginfod1t64_0.192-4_arm64.deb ... 202s Unpacking libdebuginfod1t64:arm64 (0.192-4) ... 202s Selecting previously unselected package libsource-highlight-common. 202s Preparing to unpack .../022-libsource-highlight-common_3.1.9-4.3build1_all.deb ... 202s Unpacking libsource-highlight-common (3.1.9-4.3build1) ... 202s Selecting previously unselected package libsource-highlight4t64:arm64. 202s Preparing to unpack .../023-libsource-highlight4t64_3.1.9-4.3build1_arm64.deb ... 202s Unpacking libsource-highlight4t64:arm64 (3.1.9-4.3build1) ... 202s Selecting previously unselected package gdb. 202s Preparing to unpack .../024-gdb_15.1-1ubuntu2_arm64.deb ... 202s Unpacking gdb (15.1-1ubuntu2) ... 202s Selecting previously unselected package libaec0:arm64. 202s Preparing to unpack .../025-libaec0_1.1.3-1_arm64.deb ... 202s Unpacking libaec0:arm64 (1.1.3-1) ... 202s Selecting previously unselected package libargon2-1:arm64. 202s Preparing to unpack .../026-libargon2-1_0~20190702+dfsg-4build1_arm64.deb ... 202s Unpacking libargon2-1:arm64 (0~20190702+dfsg-4build1) ... 202s Selecting previously unselected package libblas3:arm64. 202s Preparing to unpack .../027-libblas3_3.12.0-4_arm64.deb ... 202s Unpacking libblas3:arm64 (3.12.0-4) ... 202s Selecting previously unselected package libcares2:arm64. 202s Preparing to unpack .../028-libcares2_1.34.2-1_arm64.deb ... 202s Unpacking libcares2:arm64 (1.34.2-1) ... 202s Selecting previously unselected package libdeflate0:arm64. 202s Preparing to unpack .../029-libdeflate0_1.22-1_arm64.deb ... 202s Unpacking libdeflate0:arm64 (1.22-1) ... 202s Selecting previously unselected package libgfortran5:arm64. 202s Preparing to unpack .../030-libgfortran5_14.2.0-8ubuntu1_arm64.deb ... 202s Unpacking libgfortran5:arm64 (14.2.0-8ubuntu1) ... 202s Selecting previously unselected package libgomp1:arm64. 202s Preparing to unpack .../031-libgomp1_14.2.0-8ubuntu1_arm64.deb ... 202s Unpacking libgomp1:arm64 (14.2.0-8ubuntu1) ... 202s Selecting previously unselected package libgraphite2-3:arm64. 202s Preparing to unpack .../032-libgraphite2-3_1.3.14-2ubuntu1_arm64.deb ... 202s Unpacking libgraphite2-3:arm64 (1.3.14-2ubuntu1) ... 203s Selecting previously unselected package libharfbuzz0b:arm64. 203s Preparing to unpack .../033-libharfbuzz0b_10.0.1-1_arm64.deb ... 203s Unpacking libharfbuzz0b:arm64 (10.0.1-1) ... 203s Selecting previously unselected package libsz2:arm64. 203s Preparing to unpack .../034-libsz2_1.1.3-1_arm64.deb ... 203s Unpacking libsz2:arm64 (1.1.3-1) ... 203s Selecting previously unselected package libhdf5-103-1t64:arm64. 203s Preparing to unpack .../035-libhdf5-103-1t64_1.10.10+repack-4ubuntu3_arm64.deb ... 203s Unpacking libhdf5-103-1t64:arm64 (1.10.10+repack-4ubuntu3) ... 203s Selecting previously unselected package libhdf5-hl-100t64:arm64. 203s Preparing to unpack .../036-libhdf5-hl-100t64_1.10.10+repack-4ubuntu3_arm64.deb ... 203s Unpacking libhdf5-hl-100t64:arm64 (1.10.10+repack-4ubuntu3) ... 203s Selecting previously unselected package libimagequant0:arm64. 203s Preparing to unpack .../037-libimagequant0_2.18.0-1build1_arm64.deb ... 203s Unpacking libimagequant0:arm64 (2.18.0-1build1) ... 203s Selecting previously unselected package libjpeg-turbo8:arm64. 203s Preparing to unpack .../038-libjpeg-turbo8_2.1.5-3ubuntu2_arm64.deb ... 203s Unpacking libjpeg-turbo8:arm64 (2.1.5-3ubuntu2) ... 203s Selecting previously unselected package libjpeg8:arm64. 203s Preparing to unpack .../039-libjpeg8_8c-2ubuntu11_arm64.deb ... 203s Unpacking libjpeg8:arm64 (8c-2ubuntu11) ... 203s Selecting previously unselected package libjs-bootstrap. 203s Preparing to unpack .../040-libjs-bootstrap_3.4.1+dfsg-3_all.deb ... 203s Unpacking libjs-bootstrap (3.4.1+dfsg-3) ... 203s Selecting previously unselected package libjs-jquery. 203s Preparing to unpack .../041-libjs-jquery_3.6.1+dfsg+~3.5.14-1_all.deb ... 203s Unpacking libjs-jquery (3.6.1+dfsg+~3.5.14-1) ... 203s Selecting previously unselected package libjs-jquery-ui. 203s Preparing to unpack .../042-libjs-jquery-ui_1.13.2+dfsg-1_all.deb ... 203s Unpacking libjs-jquery-ui (1.13.2+dfsg-1) ... 203s Selecting previously unselected package libjs-underscore. 203s Preparing to unpack .../043-libjs-underscore_1.13.4~dfsg+~1.11.4-3_all.deb ... 203s Unpacking libjs-underscore (1.13.4~dfsg+~1.11.4-3) ... 203s Selecting previously unselected package libjs-sphinxdoc. 203s Preparing to unpack .../044-libjs-sphinxdoc_7.4.7-4_all.deb ... 203s Unpacking libjs-sphinxdoc (7.4.7-4) ... 203s Selecting previously unselected package libjs-sprintf-js. 203s Preparing to unpack .../045-libjs-sprintf-js_1.1.2+ds1+~1.1.2-1_all.deb ... 203s Unpacking libjs-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 203s Selecting previously unselected package liblapack3:arm64. 203s Preparing to unpack .../046-liblapack3_3.12.0-4_arm64.deb ... 203s Unpacking liblapack3:arm64 (3.12.0-4) ... 203s Selecting previously unselected package liblbfgsb0:arm64. 203s Preparing to unpack .../047-liblbfgsb0_3.0+dfsg.4-1build1_arm64.deb ... 203s Unpacking liblbfgsb0:arm64 (3.0+dfsg.4-1build1) ... 203s Selecting previously unselected package liblcms2-2:arm64. 203s Preparing to unpack .../048-liblcms2-2_2.16-2_arm64.deb ... 203s Unpacking liblcms2-2:arm64 (2.16-2) ... 204s Selecting previously unselected package liblerc4:arm64. 204s Preparing to unpack .../049-liblerc4_4.0.0+ds-5ubuntu1_arm64.deb ... 204s Unpacking liblerc4:arm64 (4.0.0+ds-5ubuntu1) ... 204s Selecting previously unselected package liblzf1:arm64. 204s Preparing to unpack .../050-liblzf1_3.6-4_arm64.deb ... 204s Unpacking liblzf1:arm64 (3.6-4) ... 204s Selecting previously unselected package libnetcdf19t64:arm64. 204s Preparing to unpack .../051-libnetcdf19t64_1%3a4.9.2-6ubuntu1_arm64.deb ... 204s Unpacking libnetcdf19t64:arm64 (1:4.9.2-6ubuntu1) ... 204s Selecting previously unselected package node-xtend. 204s Preparing to unpack .../052-node-xtend_4.0.2-3_all.deb ... 204s Unpacking node-xtend (4.0.2-3) ... 204s Selecting previously unselected package nodejs. 204s Preparing to unpack .../053-nodejs_20.18.0+dfsg-2_arm64.deb ... 204s Unpacking nodejs (20.18.0+dfsg-2) ... 204s Selecting previously unselected package node-acorn. 204s Preparing to unpack .../054-node-acorn_8.8.1+ds+~cs25.17.7-2_all.deb ... 204s Unpacking node-acorn (8.8.1+ds+~cs25.17.7-2) ... 204s Selecting previously unselected package node-cjs-module-lexer. 204s Preparing to unpack .../055-node-cjs-module-lexer_1.2.3+dfsg-1_all.deb ... 204s Unpacking node-cjs-module-lexer (1.2.3+dfsg-1) ... 204s Selecting previously unselected package node-balanced-match. 204s Preparing to unpack .../056-node-balanced-match_2.0.0-1_all.deb ... 204s Unpacking node-balanced-match (2.0.0-1) ... 204s Selecting previously unselected package node-brace-expansion. 204s Preparing to unpack .../057-node-brace-expansion_2.0.1+~1.1.0-1_all.deb ... 204s Unpacking node-brace-expansion (2.0.1+~1.1.0-1) ... 204s Selecting previously unselected package node-minimatch. 204s Preparing to unpack .../058-node-minimatch_9.0.3-5_all.deb ... 204s Unpacking node-minimatch (9.0.3-5) ... 204s Selecting previously unselected package node-undici. 204s Preparing to unpack .../059-node-undici_5.28.4+dfsg1+~cs23.12.11-2_all.deb ... 204s Unpacking node-undici (5.28.4+dfsg1+~cs23.12.11-2) ... 204s Selecting previously unselected package libnode115:arm64. 204s Preparing to unpack .../060-libnode115_20.18.0+dfsg-2_arm64.deb ... 204s Unpacking libnode115:arm64 (20.18.0+dfsg-2) ... 205s Selecting previously unselected package libnorm1t64:arm64. 205s Preparing to unpack .../061-libnorm1t64_1.5.9+dfsg-3.1build1_arm64.deb ... 205s Unpacking libnorm1t64:arm64 (1.5.9+dfsg-3.1build1) ... 205s Selecting previously unselected package libpgm-5.3-0t64:arm64. 205s Preparing to unpack .../062-libpgm-5.3-0t64_5.3.128~dfsg-2.1build1_arm64.deb ... 205s Unpacking libpgm-5.3-0t64:arm64 (5.3.128~dfsg-2.1build1) ... 205s Selecting previously unselected package libpython3.13-stdlib:arm64. 205s Preparing to unpack .../063-libpython3.13-stdlib_3.13.0-2_arm64.deb ... 205s Unpacking libpython3.13-stdlib:arm64 (3.13.0-2) ... 205s Selecting previously unselected package libqhull-r8.0:arm64. 205s Preparing to unpack .../064-libqhull-r8.0_2020.2-6build1_arm64.deb ... 205s Unpacking libqhull-r8.0:arm64 (2020.2-6build1) ... 205s Selecting previously unselected package libraqm0:arm64. 205s Preparing to unpack .../065-libraqm0_0.10.1-1build1_arm64.deb ... 205s Unpacking libraqm0:arm64 (0.10.1-1build1) ... 205s Selecting previously unselected package libsharpyuv0:arm64. 205s Preparing to unpack .../066-libsharpyuv0_1.4.0-0.1_arm64.deb ... 205s Unpacking libsharpyuv0:arm64 (1.4.0-0.1) ... 205s Selecting previously unselected package libsodium23:arm64. 205s Preparing to unpack .../067-libsodium23_1.0.18-1build3_arm64.deb ... 205s Unpacking libsodium23:arm64 (1.0.18-1build3) ... 205s Selecting previously unselected package libjbig0:arm64. 205s Preparing to unpack .../068-libjbig0_2.1-6.1ubuntu2_arm64.deb ... 205s Unpacking libjbig0:arm64 (2.1-6.1ubuntu2) ... 205s Selecting previously unselected package libwebp7:arm64. 205s Preparing to unpack .../069-libwebp7_1.4.0-0.1_arm64.deb ... 205s Unpacking libwebp7:arm64 (1.4.0-0.1) ... 205s Selecting previously unselected package libtiff6:arm64. 205s Preparing to unpack .../070-libtiff6_4.5.1+git230720-4ubuntu4_arm64.deb ... 205s Unpacking libtiff6:arm64 (4.5.1+git230720-4ubuntu4) ... 205s Selecting previously unselected package libwebpdemux2:arm64. 205s Preparing to unpack .../071-libwebpdemux2_1.4.0-0.1_arm64.deb ... 205s Unpacking libwebpdemux2:arm64 (1.4.0-0.1) ... 205s Selecting previously unselected package libwebpmux3:arm64. 205s Preparing to unpack .../072-libwebpmux3_1.4.0-0.1_arm64.deb ... 205s Unpacking libwebpmux3:arm64 (1.4.0-0.1) ... 205s Selecting previously unselected package libxslt1.1:arm64. 205s Preparing to unpack .../073-libxslt1.1_1.1.39-0exp1ubuntu1_arm64.deb ... 205s Unpacking libxslt1.1:arm64 (1.1.39-0exp1ubuntu1) ... 205s Selecting previously unselected package libzmq5:arm64. 205s Preparing to unpack .../074-libzmq5_4.3.5-1build2_arm64.deb ... 205s Unpacking libzmq5:arm64 (4.3.5-1build2) ... 205s Selecting previously unselected package node-esprima. 206s Preparing to unpack .../075-node-esprima_4.0.1+ds+~4.0.3-2_all.deb ... 206s Unpacking node-esprima (4.0.1+ds+~4.0.3-2) ... 206s Selecting previously unselected package node-sprintf-js. 206s Preparing to unpack .../076-node-sprintf-js_1.1.2+ds1+~1.1.2-1_all.deb ... 206s Unpacking node-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 206s Selecting previously unselected package node-argparse. 206s Preparing to unpack .../077-node-argparse_2.0.1-2_all.deb ... 206s Unpacking node-argparse (2.0.1-2) ... 206s Selecting previously unselected package node-js-yaml. 206s Preparing to unpack .../078-node-js-yaml_4.1.0+dfsg+~4.0.5-7_all.deb ... 206s Unpacking node-js-yaml (4.1.0+dfsg+~4.0.5-7) ... 206s Selecting previously unselected package libjs-mathjax. 206s Preparing to unpack .../079-libjs-mathjax_2.7.9+dfsg-1_all.deb ... 206s Unpacking libjs-mathjax (2.7.9+dfsg-1) ... 206s Selecting previously unselected package python-dask-doc. 206s Preparing to unpack .../080-python-dask-doc_2024.5.2+dfsg-1_all.deb ... 206s Unpacking python-dask-doc (2024.5.2+dfsg-1) ... 207s Selecting previously unselected package sphinx-rtd-theme-common. 207s Preparing to unpack .../081-sphinx-rtd-theme-common_3.0.2+dfsg-1_all.deb ... 207s Unpacking sphinx-rtd-theme-common (3.0.2+dfsg-1) ... 207s Selecting previously unselected package python-fsspec-doc. 207s Preparing to unpack .../082-python-fsspec-doc_2024.9.0-1_all.deb ... 207s Unpacking python-fsspec-doc (2024.9.0-1) ... 207s Selecting previously unselected package python-numpy-doc. 207s Preparing to unpack .../083-python-numpy-doc_1%3a1.26.4+ds-11ubuntu1_all.deb ... 207s Unpacking python-numpy-doc (1:1.26.4+ds-11ubuntu1) ... 208s Selecting previously unselected package python-pandas-doc. 208s Preparing to unpack .../084-python-pandas-doc_2.2.3+dfsg-5ubuntu1_all.deb ... 208s Unpacking python-pandas-doc (2.2.3+dfsg-5ubuntu1) ... 209s Selecting previously unselected package python3.12-doc. 209s Preparing to unpack .../085-python3.12-doc_3.12.7-3_all.deb ... 209s Unpacking python3.12-doc (3.12.7-3) ... 211s Selecting previously unselected package python3-doc. 211s Preparing to unpack .../086-python3-doc_3.12.7-1_all.deb ... 211s Unpacking python3-doc (3.12.7-1) ... 211s Selecting previously unselected package sass-stylesheets-bulma. 211s Preparing to unpack .../087-sass-stylesheets-bulma_0.9.4~ds-1_all.deb ... 211s Unpacking sass-stylesheets-bulma (0.9.4~ds-1) ... 211s Selecting previously unselected package python-distributed-doc. 211s Preparing to unpack .../088-python-distributed-doc_2024.5.2+ds.1-8_all.deb ... 211s Unpacking python-distributed-doc (2024.5.2+ds.1-8) ... 211s Selecting previously unselected package python-matplotlib-data. 211s Preparing to unpack .../089-python-matplotlib-data_3.8.3-3ubuntu1_all.deb ... 211s Unpacking python-matplotlib-data (3.8.3-3ubuntu1) ... 211s Selecting previously unselected package python-tinycss2-common. 211s Preparing to unpack .../090-python-tinycss2-common_1.4.0-1_all.deb ... 211s Unpacking python-tinycss2-common (1.4.0-1) ... 211s Selecting previously unselected package python3-multidict. 211s Preparing to unpack .../091-python3-multidict_6.1.0-1build1_arm64.deb ... 211s Unpacking python3-multidict (6.1.0-1build1) ... 211s Selecting previously unselected package python3-yarl. 211s Preparing to unpack .../092-python3-yarl_1.9.4-1_arm64.deb ... 211s Unpacking python3-yarl (1.9.4-1) ... 211s Selecting previously unselected package python3-async-timeout. 211s Preparing to unpack .../093-python3-async-timeout_4.0.3-1_all.deb ... 211s Unpacking python3-async-timeout (4.0.3-1) ... 211s Selecting previously unselected package python3-frozenlist. 211s Preparing to unpack .../094-python3-frozenlist_1.5.0-1build1_arm64.deb ... 211s Unpacking python3-frozenlist (1.5.0-1build1) ... 211s Selecting previously unselected package python3-aiosignal. 211s Preparing to unpack .../095-python3-aiosignal_1.3.1-1_all.deb ... 211s Unpacking python3-aiosignal (1.3.1-1) ... 211s Selecting previously unselected package python3-aiohttp. 211s Preparing to unpack .../096-python3-aiohttp_3.9.5-1_arm64.deb ... 211s Unpacking python3-aiohttp (3.9.5-1) ... 211s Selecting previously unselected package python3.13. 211s Preparing to unpack .../097-python3.13_3.13.0-2_arm64.deb ... 211s Unpacking python3.13 (3.13.0-2) ... 211s Selecting previously unselected package python3-all. 211s Preparing to unpack .../098-python3-all_3.12.7-1_arm64.deb ... 211s Unpacking python3-all (3.12.7-1) ... 211s Selecting previously unselected package python3-sniffio. 211s Preparing to unpack .../099-python3-sniffio_1.3.1-1_all.deb ... 211s Unpacking python3-sniffio (1.3.1-1) ... 211s Selecting previously unselected package python3-anyio. 211s Preparing to unpack .../100-python3-anyio_4.6.2-4_all.deb ... 211s Unpacking python3-anyio (4.6.2-4) ... 211s Selecting previously unselected package python3-appdirs. 211s Preparing to unpack .../101-python3-appdirs_1.4.4-4_all.deb ... 211s Unpacking python3-appdirs (1.4.4-4) ... 211s Selecting previously unselected package python3-argon2. 211s Preparing to unpack .../102-python3-argon2_21.1.0-2build1_arm64.deb ... 211s Unpacking python3-argon2 (21.1.0-2build1) ... 211s Selecting previously unselected package python3-dateutil. 211s Preparing to unpack .../103-python3-dateutil_2.9.0-3_all.deb ... 211s Unpacking python3-dateutil (2.9.0-3) ... 211s Selecting previously unselected package python3-arrow. 211s Preparing to unpack .../104-python3-arrow_1.3.0-1.1ubuntu1_all.deb ... 211s Unpacking python3-arrow (1.3.0-1.1ubuntu1) ... 211s Selecting previously unselected package python3-asttokens. 211s Preparing to unpack .../105-python3-asttokens_2.4.1-2_all.deb ... 211s Unpacking python3-asttokens (2.4.1-2) ... 211s Selecting previously unselected package python3-webencodings. 211s Preparing to unpack .../106-python3-webencodings_0.5.1-5_all.deb ... 211s Unpacking python3-webencodings (0.5.1-5) ... 211s Selecting previously unselected package python3-html5lib. 211s Preparing to unpack .../107-python3-html5lib_1.2-1_all.deb ... 211s Unpacking python3-html5lib (1.2-1) ... 211s Selecting previously unselected package python3-bleach. 211s Preparing to unpack .../108-python3-bleach_6.2.0-1_all.deb ... 211s Unpacking python3-bleach (6.2.0-1) ... 211s Selecting previously unselected package python3-brotli. 211s Preparing to unpack .../109-python3-brotli_1.1.0-2build3_arm64.deb ... 211s Unpacking python3-brotli (1.1.0-2build3) ... 211s Selecting previously unselected package python3-soupsieve. 211s Preparing to unpack .../110-python3-soupsieve_2.6-1_all.deb ... 211s Unpacking python3-soupsieve (2.6-1) ... 211s Selecting previously unselected package python3-bs4. 211s Preparing to unpack .../111-python3-bs4_4.12.3-3_all.deb ... 211s Unpacking python3-bs4 (4.12.3-3) ... 211s Selecting previously unselected package python3-numpy. 211s Preparing to unpack .../112-python3-numpy_1%3a1.26.4+ds-11ubuntu1_arm64.deb ... 211s Unpacking python3-numpy (1:1.26.4+ds-11ubuntu1) ... 212s Selecting previously unselected package python3-cftime. 212s Preparing to unpack .../113-python3-cftime_1.6.4-1build1_arm64.deb ... 212s Unpacking python3-cftime (1.6.4-1build1) ... 212s Selecting previously unselected package python3-colorama. 212s Preparing to unpack .../114-python3-colorama_0.4.6-4_all.deb ... 212s Unpacking python3-colorama (0.4.6-4) ... 212s Selecting previously unselected package python3-click. 212s Preparing to unpack .../115-python3-click_8.1.7-2_all.deb ... 212s Unpacking python3-click (8.1.7-2) ... 212s Selecting previously unselected package python3-cloudpickle. 212s Preparing to unpack .../116-python3-cloudpickle_3.0.0-2_all.deb ... 212s Unpacking python3-cloudpickle (3.0.0-2) ... 212s Selecting previously unselected package python3-traitlets. 212s Preparing to unpack .../117-python3-traitlets_5.14.3+really5.14.3-1_all.deb ... 212s Unpacking python3-traitlets (5.14.3+really5.14.3-1) ... 212s Selecting previously unselected package python3-comm. 212s Preparing to unpack .../118-python3-comm_0.2.1-1_all.deb ... 212s Unpacking python3-comm (0.2.1-1) ... 212s Selecting previously unselected package python3-contourpy. 212s Preparing to unpack .../119-python3-contourpy_1.3.0-2build1_arm64.deb ... 212s Unpacking python3-contourpy (1.3.0-2build1) ... 212s Selecting previously unselected package python3-coverage. 212s Preparing to unpack .../120-python3-coverage_7.4.4+dfsg1-0ubuntu3_arm64.deb ... 212s Unpacking python3-coverage (7.4.4+dfsg1-0ubuntu3) ... 212s Selecting previously unselected package python3-cycler. 212s Preparing to unpack .../121-python3-cycler_0.12.1-1_all.deb ... 212s Unpacking python3-cycler (0.12.1-1) ... 212s Selecting previously unselected package python3-fsspec. 212s Preparing to unpack .../122-python3-fsspec_2024.9.0-1_all.deb ... 212s Unpacking python3-fsspec (2024.9.0-1) ... 212s Selecting previously unselected package python3-toolz. 212s Preparing to unpack .../123-python3-toolz_1.0.0-1_all.deb ... 212s Unpacking python3-toolz (1.0.0-1) ... 212s Selecting previously unselected package python3-packaging. 212s Preparing to unpack .../124-python3-packaging_24.2-1_all.deb ... 212s Unpacking python3-packaging (24.2-1) ... 212s Selecting previously unselected package python3-locket. 212s Preparing to unpack .../125-python3-locket_1.0.0-2_all.deb ... 212s Unpacking python3-locket (1.0.0-2) ... 212s Selecting previously unselected package python3-partd. 212s Preparing to unpack .../126-python3-partd_1.4.2-1_all.deb ... 212s Unpacking python3-partd (1.4.2-1) ... 212s Selecting previously unselected package python3-dask. 213s Preparing to unpack .../127-python3-dask_2024.5.2+dfsg-1_all.deb ... 213s Unpacking python3-dask (2024.5.2+dfsg-1) ... 213s Selecting previously unselected package python3-debugpy. 213s Preparing to unpack .../128-python3-debugpy_1.8.8+ds-2ubuntu1_arm64.deb ... 213s Unpacking python3-debugpy (1.8.8+ds-2ubuntu1) ... 213s Selecting previously unselected package python3-decorator. 213s Preparing to unpack .../129-python3-decorator_5.1.1-5_all.deb ... 213s Unpacking python3-decorator (5.1.1-5) ... 213s Selecting previously unselected package python3-defusedxml. 213s Preparing to unpack .../130-python3-defusedxml_0.7.1-2_all.deb ... 213s Unpacking python3-defusedxml (0.7.1-2) ... 213s Selecting previously unselected package python3-dill. 213s Preparing to unpack .../131-python3-dill_0.3.9-1_all.deb ... 213s Unpacking python3-dill (0.3.9-1) ... 213s Selecting previously unselected package python3-msgpack. 213s Preparing to unpack .../132-python3-msgpack_1.0.3-3build3_arm64.deb ... 213s Unpacking python3-msgpack (1.0.3-3build3) ... 213s Selecting previously unselected package python3-psutil. 213s Preparing to unpack .../133-python3-psutil_5.9.8-2build3_arm64.deb ... 213s Unpacking python3-psutil (5.9.8-2build3) ... 213s Selecting previously unselected package python3-sortedcontainers. 213s Preparing to unpack .../134-python3-sortedcontainers_2.4.0-2_all.deb ... 213s Unpacking python3-sortedcontainers (2.4.0-2) ... 213s Selecting previously unselected package python3-tblib. 213s Preparing to unpack .../135-python3-tblib_3.0.0-5_all.deb ... 213s Unpacking python3-tblib (3.0.0-5) ... 213s Selecting previously unselected package python3-tornado. 213s Preparing to unpack .../136-python3-tornado_6.4.1-3_arm64.deb ... 213s Unpacking python3-tornado (6.4.1-3) ... 213s Selecting previously unselected package python3-zict. 213s Preparing to unpack .../137-python3-zict_3.0.0-2ubuntu1_all.deb ... 213s Unpacking python3-zict (3.0.0-2ubuntu1) ... 213s Selecting previously unselected package python3-distributed. 213s Preparing to unpack .../138-python3-distributed_2024.5.2+ds.1-8_all.deb ... 213s Unpacking python3-distributed (2024.5.2+ds.1-8) ... 213s Selecting previously unselected package python3-executing. 213s Preparing to unpack .../139-python3-executing_2.1.0-0.1_all.deb ... 213s Unpacking python3-executing (2.1.0-0.1) ... 213s Selecting previously unselected package python3-fastjsonschema. 213s Preparing to unpack .../140-python3-fastjsonschema_2.20.0-1_all.deb ... 213s Unpacking python3-fastjsonschema (2.20.0-1) ... 214s Selecting previously unselected package python3-tz. 214s Preparing to unpack .../141-python3-tz_2024.1-2_all.deb ... 214s Unpacking python3-tz (2024.1-2) ... 214s Selecting previously unselected package python3-six. 214s Preparing to unpack .../142-python3-six_1.16.0-7_all.deb ... 214s Unpacking python3-six (1.16.0-7) ... 214s Selecting previously unselected package python3-fs. 214s Preparing to unpack .../143-python3-fs_2.4.16-4_all.deb ... 214s Unpacking python3-fs (2.4.16-4) ... 214s Selecting previously unselected package python3-lxml:arm64. 214s Preparing to unpack .../144-python3-lxml_5.3.0-1build1_arm64.deb ... 214s Unpacking python3-lxml:arm64 (5.3.0-1build1) ... 214s Selecting previously unselected package python3-lz4. 214s Preparing to unpack .../145-python3-lz4_4.0.2+dfsg-1build5_arm64.deb ... 214s Unpacking python3-lz4 (4.0.2+dfsg-1build5) ... 214s Selecting previously unselected package python3-scipy. 214s Preparing to unpack .../146-python3-scipy_1.13.1-5ubuntu1_arm64.deb ... 214s Unpacking python3-scipy (1.13.1-5ubuntu1) ... 215s Selecting previously unselected package python3-mpmath. 215s Preparing to unpack .../147-python3-mpmath_1.3.0-1_all.deb ... 215s Unpacking python3-mpmath (1.3.0-1) ... 215s Selecting previously unselected package python3-sympy. 215s Preparing to unpack .../148-python3-sympy_1.13.3-1_all.deb ... 215s Unpacking python3-sympy (1.13.3-1) ... 215s Selecting previously unselected package python3-ufolib2. 215s Preparing to unpack .../149-python3-ufolib2_0.16.1+dfsg1-1_all.deb ... 215s Unpacking python3-ufolib2 (0.16.1+dfsg1-1) ... 215s Selecting previously unselected package unicode-data. 215s Preparing to unpack .../150-unicode-data_15.1.0-1_all.deb ... 215s Unpacking unicode-data (15.1.0-1) ... 215s Selecting previously unselected package python3-fonttools. 215s Preparing to unpack .../151-python3-fonttools_4.55.0-3_arm64.deb ... 215s Unpacking python3-fonttools (4.55.0-3) ... 215s Selecting previously unselected package python3-fqdn. 215s Preparing to unpack .../152-python3-fqdn_1.5.1-2_all.deb ... 215s Unpacking python3-fqdn (1.5.1-2) ... 216s Selecting previously unselected package python3-h5py-serial. 216s Preparing to unpack .../153-python3-h5py-serial_3.11.0-5ubuntu1_arm64.deb ... 216s Unpacking python3-h5py-serial (3.11.0-5ubuntu1) ... 216s Selecting previously unselected package python3-h5py. 216s Preparing to unpack .../154-python3-h5py_3.11.0-5ubuntu1_all.deb ... 216s Unpacking python3-h5py (3.11.0-5ubuntu1) ... 216s Selecting previously unselected package python3-iniconfig. 216s Preparing to unpack .../155-python3-iniconfig_1.1.1-2_all.deb ... 216s Unpacking python3-iniconfig (1.1.1-2) ... 216s Selecting previously unselected package python3-parso. 216s Preparing to unpack .../156-python3-parso_0.8.3-1_all.deb ... 216s Unpacking python3-parso (0.8.3-1) ... 216s Selecting previously unselected package python3-typeshed. 216s Preparing to unpack .../157-python3-typeshed_0.0~git20231111.6764465-3_all.deb ... 216s Unpacking python3-typeshed (0.0~git20231111.6764465-3) ... 216s Selecting previously unselected package python3-jedi. 216s Preparing to unpack .../158-python3-jedi_0.19.1+ds1-1_all.deb ... 216s Unpacking python3-jedi (0.19.1+ds1-1) ... 217s Selecting previously unselected package python3-matplotlib-inline. 217s Preparing to unpack .../159-python3-matplotlib-inline_0.1.6-2_all.deb ... 217s Unpacking python3-matplotlib-inline (0.1.6-2) ... 217s Selecting previously unselected package python3-wcwidth. 217s Preparing to unpack .../160-python3-wcwidth_0.2.13+dfsg1-1_all.deb ... 217s Unpacking python3-wcwidth (0.2.13+dfsg1-1) ... 217s Selecting previously unselected package python3-prompt-toolkit. 217s Preparing to unpack .../161-python3-prompt-toolkit_3.0.48-1_all.deb ... 217s Unpacking python3-prompt-toolkit (3.0.48-1) ... 217s Selecting previously unselected package python3-pure-eval. 217s Preparing to unpack .../162-python3-pure-eval_0.2.3-1_all.deb ... 217s Unpacking python3-pure-eval (0.2.3-1) ... 217s Selecting previously unselected package python3-stack-data. 217s Preparing to unpack .../163-python3-stack-data_0.6.3-1_all.deb ... 217s Unpacking python3-stack-data (0.6.3-1) ... 217s Selecting previously unselected package python3-ptyprocess. 217s Preparing to unpack .../164-python3-ptyprocess_0.7.0-6_all.deb ... 217s Unpacking python3-ptyprocess (0.7.0-6) ... 217s Selecting previously unselected package python3-pexpect. 217s Preparing to unpack .../165-python3-pexpect_4.9-3_all.deb ... 217s Unpacking python3-pexpect (4.9-3) ... 217s Selecting previously unselected package python3-ipython. 217s Preparing to unpack .../166-python3-ipython_8.29.0-1_all.deb ... 217s Unpacking python3-ipython (8.29.0-1) ... 217s Selecting previously unselected package python3-platformdirs. 217s Preparing to unpack .../167-python3-platformdirs_4.3.6-1_all.deb ... 217s Unpacking python3-platformdirs (4.3.6-1) ... 217s Selecting previously unselected package python3-jupyter-core. 217s Preparing to unpack .../168-python3-jupyter-core_5.7.2-4_all.deb ... 217s Unpacking python3-jupyter-core (5.7.2-4) ... 217s Selecting previously unselected package python3-py. 217s Preparing to unpack .../169-python3-py_1.11.0-2_all.deb ... 217s Unpacking python3-py (1.11.0-2) ... 217s Selecting previously unselected package python3-zmq. 217s Preparing to unpack .../170-python3-zmq_24.0.1-5build2_arm64.deb ... 217s Unpacking python3-zmq (24.0.1-5build2) ... 217s Selecting previously unselected package python3-jupyter-client. 217s Preparing to unpack .../171-python3-jupyter-client_8.6.3-1_all.deb ... 217s Unpacking python3-jupyter-client (8.6.3-1) ... 217s Selecting previously unselected package python3-nest-asyncio. 217s Preparing to unpack .../172-python3-nest-asyncio_1.5.4-1_all.deb ... 217s Unpacking python3-nest-asyncio (1.5.4-1) ... 217s Selecting previously unselected package python3-ipykernel. 217s Preparing to unpack .../173-python3-ipykernel_6.29.5-1_all.deb ... 217s Unpacking python3-ipykernel (6.29.5-1) ... 218s Selecting previously unselected package python3-isoduration. 218s Preparing to unpack .../174-python3-isoduration_20.11.0+git20211126.ae0bd61-2_all.deb ... 218s Unpacking python3-isoduration (20.11.0+git20211126.ae0bd61-2) ... 218s Selecting previously unselected package python3-joblib. 218s Preparing to unpack .../175-python3-joblib_1.3.2-5_all.deb ... 218s Unpacking python3-joblib (1.3.2-5) ... 218s Selecting previously unselected package python3-pythonjsonlogger. 218s Preparing to unpack .../176-python3-pythonjsonlogger_3.1.0-1_all.deb ... 218s Unpacking python3-pythonjsonlogger (3.1.0-1) ... 218s Selecting previously unselected package python3-rfc3339-validator. 218s Preparing to unpack .../177-python3-rfc3339-validator_0.1.4-2_all.deb ... 218s Unpacking python3-rfc3339-validator (0.1.4-2) ... 218s Selecting previously unselected package python3-rfc3986-validator. 218s Preparing to unpack .../178-python3-rfc3986-validator_0.1.1-2_all.deb ... 218s Unpacking python3-rfc3986-validator (0.1.1-2) ... 218s Selecting previously unselected package python3-uritemplate. 218s Preparing to unpack .../179-python3-uritemplate_4.1.1-3_all.deb ... 218s Unpacking python3-uritemplate (4.1.1-3) ... 218s Selecting previously unselected package python3-webcolors. 218s Preparing to unpack .../180-python3-webcolors_1.13-1_all.deb ... 218s Unpacking python3-webcolors (1.13-1) ... 218s Selecting previously unselected package python3-jupyter-events. 218s Preparing to unpack .../181-python3-jupyter-events_0.10.0-3_all.deb ... 218s Unpacking python3-jupyter-events (0.10.0-3) ... 218s Selecting previously unselected package python3-terminado. 218s Preparing to unpack .../182-python3-terminado_0.18.1-1_all.deb ... 218s Unpacking python3-terminado (0.18.1-1) ... 218s Selecting previously unselected package python3-jupyter-server-terminals. 218s Preparing to unpack .../183-python3-jupyter-server-terminals_0.5.3-2_all.deb ... 218s Unpacking python3-jupyter-server-terminals (0.5.3-2) ... 218s Selecting previously unselected package python3-jupyterlab-pygments. 218s Preparing to unpack .../184-python3-jupyterlab-pygments_0.2.2-3_all.deb ... 218s Unpacking python3-jupyterlab-pygments (0.2.2-3) ... 218s Selecting previously unselected package python3-mistune. 218s Preparing to unpack .../185-python3-mistune_3.0.2-2_all.deb ... 218s Unpacking python3-mistune (3.0.2-2) ... 218s Selecting previously unselected package python3-nbformat. 218s Preparing to unpack .../186-python3-nbformat_5.9.1-1_all.deb ... 218s Unpacking python3-nbformat (5.9.1-1) ... 218s Selecting previously unselected package python3-nbclient. 218s Preparing to unpack .../187-python3-nbclient_0.8.0-1_all.deb ... 218s Unpacking python3-nbclient (0.8.0-1) ... 218s Selecting previously unselected package python3-pandocfilters. 218s Preparing to unpack .../188-python3-pandocfilters_1.5.1-1_all.deb ... 218s Unpacking python3-pandocfilters (1.5.1-1) ... 218s Selecting previously unselected package python3-tinycss2. 218s Preparing to unpack .../189-python3-tinycss2_1.4.0-1_all.deb ... 218s Unpacking python3-tinycss2 (1.4.0-1) ... 218s Selecting previously unselected package python3-nbconvert. 218s Preparing to unpack .../190-python3-nbconvert_7.16.4-2_all.deb ... 218s Unpacking python3-nbconvert (7.16.4-2) ... 218s Selecting previously unselected package python3-overrides. 218s Preparing to unpack .../191-python3-overrides_7.7.0-2_all.deb ... 218s Unpacking python3-overrides (7.7.0-2) ... 218s Selecting previously unselected package python3-prometheus-client. 218s Preparing to unpack .../192-python3-prometheus-client_0.19.0+ds1-1_all.deb ... 218s Unpacking python3-prometheus-client (0.19.0+ds1-1) ... 218s Selecting previously unselected package python3-send2trash. 219s Preparing to unpack .../193-python3-send2trash_1.8.3-1_all.deb ... 219s Unpacking python3-send2trash (1.8.3-1) ... 219s Selecting previously unselected package python3-websocket. 219s Preparing to unpack .../194-python3-websocket_1.8.0-2_all.deb ... 219s Unpacking python3-websocket (1.8.0-2) ... 219s Selecting previously unselected package python3-jupyter-server. 219s Preparing to unpack .../195-python3-jupyter-server_2.14.2-4_all.deb ... 219s Unpacking python3-jupyter-server (2.14.2-4) ... 219s Selecting previously unselected package python3-kiwisolver. 219s Preparing to unpack .../196-python3-kiwisolver_1.4.7-2build1_arm64.deb ... 219s Unpacking python3-kiwisolver (1.4.7-2build1) ... 219s Selecting previously unselected package libopenjp2-7:arm64. 219s Preparing to unpack .../197-libopenjp2-7_2.5.0-2ubuntu1_arm64.deb ... 219s Unpacking libopenjp2-7:arm64 (2.5.0-2ubuntu1) ... 219s Selecting previously unselected package python3-pil:arm64. 219s Preparing to unpack .../198-python3-pil_10.4.0-1ubuntu2_arm64.deb ... 219s Unpacking python3-pil:arm64 (10.4.0-1ubuntu2) ... 219s Selecting previously unselected package python3.12-tk. 219s Preparing to unpack .../199-python3.12-tk_3.12.7-3_arm64.deb ... 219s Unpacking python3.12-tk (3.12.7-3) ... 219s Selecting previously unselected package python3.13-tk. 219s Preparing to unpack .../200-python3.13-tk_3.13.0-2_arm64.deb ... 219s Unpacking python3.13-tk (3.13.0-2) ... 219s Selecting previously unselected package python3-tk:arm64. 219s Preparing to unpack .../201-python3-tk_3.12.7-1_arm64.deb ... 219s Unpacking python3-tk:arm64 (3.12.7-1) ... 219s Selecting previously unselected package python3-pil.imagetk:arm64. 219s Preparing to unpack .../202-python3-pil.imagetk_10.4.0-1ubuntu2_arm64.deb ... 219s Unpacking python3-pil.imagetk:arm64 (10.4.0-1ubuntu2) ... 219s Selecting previously unselected package python3-matplotlib. 219s Preparing to unpack .../203-python3-matplotlib_3.8.3-3ubuntu1_arm64.deb ... 219s Unpacking python3-matplotlib (3.8.3-3ubuntu1) ... 219s Selecting previously unselected package python3-nacl. 219s Preparing to unpack .../204-python3-nacl_1.5.0-6_arm64.deb ... 219s Unpacking python3-nacl (1.5.0-6) ... 219s Selecting previously unselected package python3-netcdf4. 219s Preparing to unpack .../205-python3-netcdf4_1.7.2-1build1_arm64.deb ... 219s Unpacking python3-netcdf4 (1.7.2-1build1) ... 219s Selecting previously unselected package python3-pandas-lib:arm64. 219s Preparing to unpack .../206-python3-pandas-lib_2.2.3+dfsg-5ubuntu1_arm64.deb ... 219s Unpacking python3-pandas-lib:arm64 (2.2.3+dfsg-5ubuntu1) ... 220s Selecting previously unselected package python3-pandas. 220s Preparing to unpack .../207-python3-pandas_2.2.3+dfsg-5ubuntu1_all.deb ... 220s Unpacking python3-pandas (2.2.3+dfsg-5ubuntu1) ... 221s Selecting previously unselected package python3-bcrypt. 221s Preparing to unpack .../208-python3-bcrypt_4.2.0-2.1_arm64.deb ... 221s Unpacking python3-bcrypt (4.2.0-2.1) ... 221s Selecting previously unselected package python3-paramiko. 221s Preparing to unpack .../209-python3-paramiko_3.4.1-2ubuntu1_all.deb ... 221s Unpacking python3-paramiko (3.4.1-2ubuntu1) ... 221s Selecting previously unselected package python3-pluggy. 221s Preparing to unpack .../210-python3-pluggy_1.5.0-1_all.deb ... 221s Unpacking python3-pluggy (1.5.0-1) ... 221s Selecting previously unselected package python3-pytest. 221s Preparing to unpack .../211-python3-pytest_8.3.3-1_all.deb ... 221s Unpacking python3-pytest (8.3.3-1) ... 221s Selecting previously unselected package python3-pytest-rerunfailures. 221s Preparing to unpack .../212-python3-pytest-rerunfailures_14.0-2_all.deb ... 221s Unpacking python3-pytest-rerunfailures (14.0-2) ... 221s Selecting previously unselected package python3-pytest-timeout. 221s Preparing to unpack .../213-python3-pytest-timeout_2.3.1-1_all.deb ... 221s Unpacking python3-pytest-timeout (2.3.1-1) ... 221s Selecting previously unselected package python3-threadpoolctl. 221s Preparing to unpack .../214-python3-threadpoolctl_3.1.0-1_all.deb ... 221s Unpacking python3-threadpoolctl (3.1.0-1) ... 221s Selecting previously unselected package python3-sklearn-lib:arm64. 221s Preparing to unpack .../215-python3-sklearn-lib_1.4.2+dfsg-6build1_arm64.deb ... 221s Unpacking python3-sklearn-lib:arm64 (1.4.2+dfsg-6build1) ... 221s Selecting previously unselected package python3-sklearn. 221s Preparing to unpack .../216-python3-sklearn_1.4.2+dfsg-6build1_all.deb ... 221s Unpacking python3-sklearn (1.4.2+dfsg-6build1) ... 221s Selecting previously unselected package tzdata-legacy. 221s Preparing to unpack .../217-tzdata-legacy_2024b-1ubuntu2_all.deb ... 221s Unpacking tzdata-legacy (2024b-1ubuntu2) ... 221s Selecting previously unselected package autopkgtest-satdep. 221s Preparing to unpack .../218-1-autopkgtest-satdep.deb ... 221s Unpacking autopkgtest-satdep (0) ... 221s Setting up libgraphite2-3:arm64 (1.3.14-2ubuntu1) ... 221s Setting up liblcms2-2:arm64 (2.16-2) ... 221s Setting up python3-iniconfig (1.1.1-2) ... 221s Setting up python3-sniffio (1.3.1-1) ... 221s Setting up python3-tornado (6.4.1-3) ... 222s Setting up libnorm1t64:arm64 (1.5.9+dfsg-3.1build1) ... 222s Setting up libsharpyuv0:arm64 (1.4.0-0.1) ... 222s Setting up python3-pure-eval (0.2.3-1) ... 222s Setting up python3-send2trash (1.8.3-1) ... 222s Setting up fonts-lato (2.015-1) ... 222s Setting up libjs-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 222s Setting up fonts-mathjax (2.7.9+dfsg-1) ... 222s Setting up libsodium23:arm64 (1.0.18-1build3) ... 222s Setting up liblerc4:arm64 (4.0.0+ds-5ubuntu1) ... 222s Setting up libjs-mathjax (2.7.9+dfsg-1) ... 223s Setting up python3-tblib (3.0.0-5) ... 223s Setting up libxrender1:arm64 (1:0.9.10-1.1build1) ... 223s Setting up python3-py (1.11.0-2) ... 223s Setting up libdebuginfod-common (0.192-4) ... 223s Setting up python3-anyio (4.6.2-4) ... 223s Setting up python3-joblib (1.3.2-5) ... 224s Setting up python3-pythonjsonlogger (3.1.0-1) ... 224s Setting up python3-parso (0.8.3-1) ... 225s Setting up python3-colorama (0.4.6-4) ... 225s Setting up python3-lz4 (4.0.2+dfsg-1build5) ... 225s Setting up python3-defusedxml (0.7.1-2) ... 225s Setting up python3-asttokens (2.4.1-2) ... 226s Setting up fonts-glyphicons-halflings (1.009~3.4.1+dfsg-3) ... 226s Setting up fonts-lyx (2.4.2.1-1) ... 226s Setting up libargon2-1:arm64 (0~20190702+dfsg-4build1) ... 226s Setting up python3-overrides (7.7.0-2) ... 226s Setting up python3-bcrypt (4.2.0-2.1) ... 226s Setting up python3-fsspec (2024.9.0-1) ... 227s Setting up python3-rfc3339-validator (0.1.4-2) ... 227s Setting up python3-threadpoolctl (3.1.0-1) ... 227s Setting up x11-common (1:7.7+23ubuntu3) ... 228s Setting up libdeflate0:arm64 (1.22-1) ... 228s Setting up libqhull-r8.0:arm64 (2020.2-6build1) ... 228s Setting up node-cjs-module-lexer (1.2.3+dfsg-1) ... 228s Setting up python3-sortedcontainers (2.4.0-2) ... 228s Setting up python3-pandocfilters (1.5.1-1) ... 228s Setting up libgomp1:arm64 (14.2.0-8ubuntu1) ... 228s Setting up python3-click (8.1.7-2) ... 228s Setting up libjbig0:arm64 (2.1-6.1ubuntu2) ... 228s Setting up python3-webencodings (0.5.1-5) ... 229s Setting up libaec0:arm64 (1.1.3-1) ... 229s Setting up python3-platformdirs (4.3.6-1) ... 229s Setting up python3-psutil (5.9.8-2build3) ... 229s Setting up python3-multidict (6.1.0-1build1) ... 230s Setting up libsource-highlight-common (3.1.9-4.3build1) ... 230s Setting up tzdata-legacy (2024b-1ubuntu2) ... 230s Setting up python3-tz (2024.1-2) ... 230s Setting up python3-cloudpickle (3.0.0-2) ... 230s Setting up python3-frozenlist (1.5.0-1build1) ... 230s Setting up python3-aiosignal (1.3.1-1) ... 230s Setting up python3-uritemplate (4.1.1-3) ... 231s Setting up python3-async-timeout (4.0.3-1) ... 231s Setting up unicode-data (15.1.0-1) ... 231s Setting up python3-jupyterlab-pygments (0.2.2-3) ... 231s Setting up python3-six (1.16.0-7) ... 231s Setting up libpython3.13-minimal:arm64 (3.13.0-2) ... 231s Setting up libpgm-5.3-0t64:arm64 (5.3.128~dfsg-2.1build1) ... 231s Setting up python3-decorator (5.1.1-5) ... 231s Setting up python3-fqdn (1.5.1-2) ... 231s Setting up libblas3:arm64 (3.12.0-4) ... 231s update-alternatives: using /usr/lib/aarch64-linux-gnu/blas/libblas.so.3 to provide /usr/lib/aarch64-linux-gnu/libblas.so.3 (libblas.so.3-aarch64-linux-gnu) in auto mode 231s Setting up python3-webcolors (1.13-1) ... 232s Setting up python3-packaging (24.2-1) ... 232s Setting up python3-wcwidth (0.2.13+dfsg1-1) ... 232s Setting up node-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 232s Setting up python3-typeshed (0.0~git20231111.6764465-3) ... 232s Setting up python3-executing (2.1.0-0.1) ... 233s Setting up node-balanced-match (2.0.0-1) ... 233s Setting up node-brace-expansion (2.0.1+~1.1.0-1) ... 233s Setting up python3-nest-asyncio (1.5.4-1) ... 233s Setting up python3-dill (0.3.9-1) ... 233s Setting up python3-brotli (1.1.0-2build3) ... 233s Setting up liblzf1:arm64 (3.6-4) ... 233s Setting up python3-cycler (0.12.1-1) ... 234s Setting up libimagequant0:arm64 (2.18.0-1build1) ... 234s Setting up python3-rfc3986-validator (0.1.1-2) ... 234s Setting up fonts-dejavu-mono (2.37-8) ... 234s Setting up python3-kiwisolver (1.4.7-2build1) ... 234s Setting up libcares2:arm64 (1.34.2-1) ... 234s Setting up libtcl8.6:arm64 (8.6.15+dfsg-2) ... 234s Setting up fonts-dejavu-core (2.37-8) ... 234s Setting up libjpeg-turbo8:arm64 (2.1.5-3ubuntu2) ... 234s Setting up python3-html5lib (1.2-1) ... 234s Setting up libbabeltrace1:arm64 (1.5.11-4build1) ... 234s Setting up libgfortran5:arm64 (14.2.0-8ubuntu1) ... 234s Setting up python3-pluggy (1.5.0-1) ... 235s Setting up libwebp7:arm64 (1.4.0-0.1) ... 235s Setting up python3-fastjsonschema (2.20.0-1) ... 235s Setting up node-undici (5.28.4+dfsg1+~cs23.12.11-2) ... 235s Setting up python3-traitlets (5.14.3+really5.14.3-1) ... 235s Setting up python-tinycss2-common (1.4.0-1) ... 235s Setting up libxslt1.1:arm64 (1.1.39-0exp1ubuntu1) ... 235s Setting up python3-argon2 (21.1.0-2build1) ... 235s Setting up libopenjp2-7:arm64 (2.5.0-2ubuntu1) ... 235s Setting up python3.13-minimal (3.13.0-2) ... 236s Setting up python3-toolz (1.0.0-1) ... 237s Setting up libharfbuzz0b:arm64 (10.0.1-1) ... 237s Setting up python3-dateutil (2.9.0-3) ... 237s Setting up python3-msgpack (1.0.3-3build3) ... 237s Setting up libxss1:arm64 (1:1.2.3-1build3) ... 237s Setting up node-minimatch (9.0.3-5) ... 237s Setting up libjs-jquery (3.6.1+dfsg+~3.5.14-1) ... 237s Setting up sass-stylesheets-bulma (0.9.4~ds-1) ... 237s Setting up python3-mpmath (1.3.0-1) ... 238s Setting up node-xtend (4.0.2-3) ... 238s Setting up python3-zict (3.0.0-2ubuntu1) ... 239s Setting up python-matplotlib-data (3.8.3-3ubuntu1) ... 239s Setting up libwebpmux3:arm64 (1.4.0-0.1) ... 239s Setting up python3-locket (1.0.0-2) ... 239s Setting up python3-appdirs (1.4.4-4) ... 239s Setting up python3-yarl (1.9.4-1) ... 239s Setting up python3-mistune (3.0.2-2) ... 240s Setting up libpython3.13-stdlib:arm64 (3.13.0-2) ... 240s Setting up python3-stack-data (0.6.3-1) ... 240s Setting up python3-soupsieve (2.6-1) ... 240s Setting up fonts-font-awesome (5.0.10+really4.7.0~dfsg-4.1) ... 240s Setting up sphinx-rtd-theme-common (3.0.2+dfsg-1) ... 240s Setting up python3-websocket (1.8.0-2) ... 241s Setting up python3-jupyter-core (5.7.2-4) ... 241s Setting up python3-nacl (1.5.0-6) ... 241s Setting up libsz2:arm64 (1.1.3-1) ... 241s Setting up libjs-bootstrap (3.4.1+dfsg-3) ... 241s Setting up libjs-underscore (1.13.4~dfsg+~1.11.4-3) ... 241s Setting up python3-ptyprocess (0.7.0-6) ... 242s Setting up libjpeg8:arm64 (8c-2ubuntu11) ... 242s Setting up python3-prompt-toolkit (3.0.48-1) ... 243s Setting up python3-partd (1.4.2-1) ... 243s Setting up python3-sympy (1.13.3-1) ... 258s Setting up libdebuginfod1t64:arm64 (0.192-4) ... 258s Setting up liblapack3:arm64 (3.12.0-4) ... 258s update-alternatives: using /usr/lib/aarch64-linux-gnu/lapack/liblapack.so.3 to provide /usr/lib/aarch64-linux-gnu/liblapack.so.3 (liblapack.so.3-aarch64-linux-gnu) in auto mode 258s Setting up python3-tinycss2 (1.4.0-1) ... 258s Setting up libzmq5:arm64 (4.3.5-1build2) ... 258s Setting up python3-arrow (1.3.0-1.1ubuntu1) ... 259s Setting up python3-jedi (0.19.1+ds1-1) ... 259s Setting up python3.13 (3.13.0-2) ... 260s Setting up fontconfig-config (2.15.0-1.1ubuntu2) ... 261s Setting up python3-pytest (8.3.3-1) ... 261s Setting up libwebpdemux2:arm64 (1.4.0-0.1) ... 261s Setting up python3-aiohttp (3.9.5-1) ... 262s Setting up python3-dask (2024.5.2+dfsg-1) ... 264s Setting up python3-isoduration (20.11.0+git20211126.ae0bd61-2) ... 265s Setting up python3-all (3.12.7-1) ... 265s Setting up python3-coverage (7.4.4+dfsg1-0ubuntu3) ... 265s Setting up libsource-highlight4t64:arm64 (3.1.9-4.3build1) ... 265s Setting up python3-nbformat (5.9.1-1) ... 265s Setting up python3-bs4 (4.12.3-3) ... 266s Setting up python3-bleach (6.2.0-1) ... 266s Setting up python3-matplotlib-inline (0.1.6-2) ... 266s Setting up python3-comm (0.2.1-1) ... 266s Setting up python3-fs (2.4.16-4) ... 266s Setting up python3-prometheus-client (0.19.0+ds1-1) ... 267s Setting up python3-distributed (2024.5.2+ds.1-8) ... 270s Setting up gdb (15.1-1ubuntu2) ... 270s Setting up libjs-jquery-ui (1.13.2+dfsg-1) ... 270s Setting up python3-pexpect (4.9-3) ... 270s Setting up python3-zmq (24.0.1-5build2) ... 270s Setting up libraqm0:arm64 (0.10.1-1build1) ... 270s Setting up python3-numpy (1:1.26.4+ds-11ubuntu1) ... 274s Setting up libjs-sphinxdoc (7.4.7-4) ... 274s Setting up python3-terminado (0.18.1-1) ... 274s Setting up python3-lxml:arm64 (5.3.0-1build1) ... 274s Setting up libtiff6:arm64 (4.5.1+git230720-4ubuntu4) ... 274s Setting up python3-jupyter-client (8.6.3-1) ... 275s Setting up python3-contourpy (1.3.0-2build1) ... 275s Setting up python3-jupyter-server-terminals (0.5.3-2) ... 275s Setting up libfontconfig1:arm64 (2.15.0-1.1ubuntu2) ... 275s Setting up python3-paramiko (3.4.1-2ubuntu1) ... 275s Setting up python3.12-doc (3.12.7-3) ... 275s Setting up libhdf5-103-1t64:arm64 (1.10.10+repack-4ubuntu3) ... 275s Setting up python3-jupyter-events (0.10.0-3) ... 276s Setting up python3-doc (3.12.7-1) ... 276s Setting up liblbfgsb0:arm64 (3.0+dfsg.4-1build1) ... 276s Setting up python-numpy-doc (1:1.26.4+ds-11ubuntu1) ... 276s Setting up libhdf5-hl-100t64:arm64 (1.10.10+repack-4ubuntu3) ... 276s Setting up python3-pytest-rerunfailures (14.0-2) ... 276s Setting up libnetcdf19t64:arm64 (1:4.9.2-6ubuntu1) ... 276s Setting up libxft2:arm64 (2.3.6-1build1) ... 276s Setting up python3-scipy (1.13.1-5ubuntu1) ... 283s Setting up python3-pytest-timeout (2.3.1-1) ... 283s Setting up python-pandas-doc (2.2.3+dfsg-5ubuntu1) ... 283s Setting up libtk8.6:arm64 (8.6.15-1) ... 283s Setting up python3-pandas-lib:arm64 (2.2.3+dfsg-5ubuntu1) ... 283s Setting up python3.12-tk (3.12.7-3) ... 283s Setting up python3-sklearn-lib:arm64 (1.4.2+dfsg-6build1) ... 283s Setting up python3-h5py-serial (3.11.0-5ubuntu1) ... 284s Setting up python3-debugpy (1.8.8+ds-2ubuntu1) ... 285s Setting up python3.13-tk (3.13.0-2) ... 285s Setting up python3-nbclient (0.8.0-1) ... 285s Setting up python3-pil:arm64 (10.4.0-1ubuntu2) ... 286s Setting up python3-pandas (2.2.3+dfsg-5ubuntu1) ... 296s Setting up python3-ipython (8.29.0-1) ... 297s Setting up python-fsspec-doc (2024.9.0-1) ... 297s Setting up python3-ipykernel (6.29.5-1) ... 297s Setting up python3-h5py (3.11.0-5ubuntu1) ... 298s Setting up python3-sklearn (1.4.2+dfsg-6build1) ... 302s Setting up python3-cftime (1.6.4-1build1) ... 302s Setting up python3-nbconvert (7.16.4-2) ... 302s Setting up python3-netcdf4 (1.7.2-1build1) ... 302s Setting up tk8.6-blt2.5 (2.5.3+dfsg-7build1) ... 302s Setting up python3-jupyter-server (2.14.2-4) ... 303s Setting up blt (2.5.3+dfsg-7build1) ... 303s Setting up python3-tk:arm64 (3.12.7-1) ... 303s Setting up python3-pil.imagetk:arm64 (10.4.0-1ubuntu2) ... 303s Setting up libnode115:arm64 (20.18.0+dfsg-2) ... 303s Setting up nodejs (20.18.0+dfsg-2) ... 303s update-alternatives: using /usr/bin/nodejs to provide /usr/bin/js (js) in auto mode 303s Setting up node-argparse (2.0.1-2) ... 303s Setting up python3-fonttools (4.55.0-3) ... 305s Setting up python3-ufolib2 (0.16.1+dfsg1-1) ... 305s Setting up node-acorn (8.8.1+ds+~cs25.17.7-2) ... 305s Setting up node-esprima (4.0.1+ds+~4.0.3-2) ... 305s Setting up node-js-yaml (4.1.0+dfsg+~4.0.5-7) ... 305s Setting up python3-matplotlib (3.8.3-3ubuntu1) ... 309s Setting up python-dask-doc (2024.5.2+dfsg-1) ... 309s Setting up python-distributed-doc (2024.5.2+ds.1-8) ... 309s Setting up autopkgtest-satdep (0) ... 309s Processing triggers for libc-bin (2.40-1ubuntu3) ... 309s Processing triggers for systemd (256.5-2ubuntu4) ... 309s Processing triggers for man-db (2.13.0-1) ... 309s Processing triggers for install-info (7.1.1-1) ... 318s (Reading database ... 122392 files and directories currently installed.) 318s Removing autopkgtest-satdep (0) ... 319s autopkgtest [00:22:50]: test pytest: [----------------------- 320s ping6: connect: Network is unreachable 320s No external ipv6 connectivity 320s Testing with python3.13: 320s *** STARTING RUN 1: python3.13 -m pytest -m not avoid_ci --verbose --timeout-method=signal --timeout=300 --durations=20 --color=no --runslow --pyargs distributed -rsfE --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures 321s ============================= test session starts ============================== 321s platform linux -- Python 3.13.0, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.13 321s cachedir: .pytest_cache 321s rootdir: /tmp/autopkgtest.Vx887U/autopkgtest_tmp 321s configfile: pyproject.toml 321s plugins: typeguard-4.4.1, timeout-2.3.1, rerunfailures-14.0, anyio-4.6.2 321s timeout: 300.0s 321s timeout method: signal 321s timeout func_only: False 330s collecting ... collected 3601 items / 3 errors / 35 deselected / 25 skipped / 3566 selected 330s 330s ==================================== ERRORS ==================================== 330s _________________ ERROR collecting cli/tests/test_dask_ssh.py __________________ 330s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_ssh.py:9: in 330s pytest.importorskip("paramiko") 330s E pytest.PytestDeprecationWarning: 330s E Module 'paramiko' was found, but when imported by pytest it raised: 330s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 330s E In pytest 9.1 this warning will become an error by default. 330s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 330s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 330s ________________ ERROR collecting deploy/tests/test_old_ssh.py _________________ 330s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py:7: in 330s pytest.importorskip("paramiko") 330s E pytest.PytestDeprecationWarning: 330s E Module 'paramiko' was found, but when imported by pytest it raised: 330s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 330s E In pytest 9.1 this warning will become an error by default. 330s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 330s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 330s _________________ ERROR collecting protocol/tests/test_h5py.py _________________ 330s /usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py:8: in 330s h5py = pytest.importorskip("h5py") 330s E pytest.PytestDeprecationWarning: 330s E Module 'h5py' was found, but when imported by pytest it raised: 330s E ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 330s E In pytest 9.1 this warning will become an error by default. 330s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 330s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 330s =========================== short test summary info ============================ 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx.py:15: could not import 'ucp': No module named 'ucp' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx_config.py:22: could not import 'ucp': No module named 'ucp' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_components.py:5: could not import 'bokeh': No module named 'bokeh' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_scheduler_bokeh.py:11: could not import 'bokeh': No module named 'bokeh' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_worker_bokeh.py:10: could not import 'bokeh': No module named 'bokeh' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_ssh.py:5: could not import 'asyncssh': No module named 'asyncssh' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_cudf_diagnostics.py:20: could not import 'cudf': No module named 'cudf' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memray.py:5: could not import 'memray': No module named 'memray' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nvml.py:10: could not import 'pynvml': No module named 'pynvml' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_stream.py:5: could not import 'bokeh': No module named 'bokeh' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_widgets.py:14: could not import 'ipywidgets': No module named 'ipywidgets' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_rmm_diagnostics.py:14: could not import 'dask_cuda': No module named 'dask_cuda' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_arrow.py:5: could not import 'pyarrow': No module named 'pyarrow' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_cupy.py:11: could not import 'cupy': No module named 'cupy' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_keras.py:5: could not import 'keras': No module named 'keras' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numba.py:11: could not import 'numba.cuda': No module named 'numba' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_rmm.py:10: could not import 'numba.cuda': No module named 'numba' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_sparse.py:6: could not import 'sparse': No module named 'sparse' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_torch.py:8: could not import 'torch': No module named 'torch' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_graph.py:9: could not import 'pyarrow': No module named 'pyarrow' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge.py:71: could not import 'pyarrow': No module named 'pyarrow' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge_column_and_index.py:110: could not import 'pyarrow': No module named 'pyarrow' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_metrics.py:71: could not import 'pyarrow': No module named 'pyarrow' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle.py:195: could not import 'pyarrow': No module named 'pyarrow' 330s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_parse_stdout.py:14: could not import 'parse_stdout': No module named 'parse_stdout' 330s ERROR cli/tests/test_dask_ssh.py - pytest.PytestDeprecationWarning: 330s Module 'paramiko' was found, but when imported by pytest it raised: 330s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 330s In pytest 9.1 this warning will become an error by default. 330s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 330s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 330s ERROR deploy/tests/test_old_ssh.py - pytest.PytestDeprecationWarning: 330s Module 'paramiko' was found, but when imported by pytest it raised: 330s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 330s In pytest 9.1 this warning will become an error by default. 330s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 330s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 330s ERROR protocol/tests/test_h5py.py - pytest.PytestDeprecationWarning: 330s Module 'h5py' was found, but when imported by pytest it raised: 330s ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 330s In pytest 9.1 this warning will become an error by default. 330s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 330s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 330s !!!!!!!!!!!!!!!!!!! Interrupted: 3 errors during collection !!!!!!!!!!!!!!!!!!!! 330s ================= 25 skipped, 35 deselected, 3 errors in 9.28s ================= 331s *** END OF RUN 1: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 331s *** STARTING RUN 2: python3.13 -m pytest -m not avoid_ci --verbose --timeout-method=signal --timeout=300 --durations=20 --color=no --runslow --pyargs distributed -rfE --last-failed --last-failed-no-failures none --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures 332s ============================= test session starts ============================== 332s platform linux -- Python 3.13.0, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.13 332s cachedir: .pytest_cache 332s rootdir: /tmp/autopkgtest.Vx887U/autopkgtest_tmp 332s configfile: pyproject.toml 332s plugins: typeguard-4.4.1, timeout-2.3.1, rerunfailures-14.0, anyio-4.6.2 332s timeout: 300.0s 332s timeout method: signal 332s timeout func_only: False 341s collecting ... collected 3601 items / 3 errors / 35 deselected / 25 skipped / 3566 selected 341s run-last-failure: 3 known failures not in selected tests 341s 341s ==================================== ERRORS ==================================== 341s _________________ ERROR collecting cli/tests/test_dask_ssh.py __________________ 341s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_ssh.py:9: in 341s pytest.importorskip("paramiko") 341s E pytest.PytestDeprecationWarning: 341s E Module 'paramiko' was found, but when imported by pytest it raised: 341s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 341s E In pytest 9.1 this warning will become an error by default. 341s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 341s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 341s ________________ ERROR collecting deploy/tests/test_old_ssh.py _________________ 341s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py:7: in 341s pytest.importorskip("paramiko") 341s E pytest.PytestDeprecationWarning: 341s E Module 'paramiko' was found, but when imported by pytest it raised: 341s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 341s E In pytest 9.1 this warning will become an error by default. 341s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 341s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 341s _________________ ERROR collecting protocol/tests/test_h5py.py _________________ 341s /usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py:8: in 341s h5py = pytest.importorskip("h5py") 341s E pytest.PytestDeprecationWarning: 341s E Module 'h5py' was found, but when imported by pytest it raised: 341s E ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 341s E In pytest 9.1 this warning will become an error by default. 341s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 341s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 341s =========================== short test summary info ============================ 341s ERROR cli/tests/test_dask_ssh.py - pytest.PytestDeprecationWarning: 341s Module 'paramiko' was found, but when imported by pytest it raised: 341s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 341s In pytest 9.1 this warning will become an error by default. 341s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 341s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 341s ERROR deploy/tests/test_old_ssh.py - pytest.PytestDeprecationWarning: 341s Module 'paramiko' was found, but when imported by pytest it raised: 341s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 341s In pytest 9.1 this warning will become an error by default. 341s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 341s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 341s ERROR protocol/tests/test_h5py.py - pytest.PytestDeprecationWarning: 341s Module 'h5py' was found, but when imported by pytest it raised: 341s ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 341s In pytest 9.1 this warning will become an error by default. 341s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 341s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 341s !!!!!!!!!!!!!!!!!!! Interrupted: 3 errors during collection !!!!!!!!!!!!!!!!!!!! 341s ================= 25 skipped, 35 deselected, 3 errors in 9.15s ================= 342s *** END OF RUN 2: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 342s *** STARTING RUN 3: python3.13 -m pytest -m not avoid_ci --verbose --timeout-method=signal --timeout=300 --durations=20 --color=no --runslow --pyargs distributed -rfE --last-failed --last-failed-no-failures none --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures 343s ============================= test session starts ============================== 343s platform linux -- Python 3.13.0, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.13 343s cachedir: .pytest_cache 343s rootdir: /tmp/autopkgtest.Vx887U/autopkgtest_tmp 343s configfile: pyproject.toml 343s plugins: typeguard-4.4.1, timeout-2.3.1, rerunfailures-14.0, anyio-4.6.2 343s timeout: 300.0s 343s timeout method: signal 343s timeout func_only: False 352s collecting ... collected 3601 items / 3 errors / 35 deselected / 25 skipped / 3566 selected 352s run-last-failure: 3 known failures not in selected tests 352s 352s ==================================== ERRORS ==================================== 352s _________________ ERROR collecting cli/tests/test_dask_ssh.py __________________ 352s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_ssh.py:9: in 352s pytest.importorskip("paramiko") 352s E pytest.PytestDeprecationWarning: 352s E Module 'paramiko' was found, but when imported by pytest it raised: 352s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 352s E In pytest 9.1 this warning will become an error by default. 352s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 352s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 352s ________________ ERROR collecting deploy/tests/test_old_ssh.py _________________ 352s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py:7: in 352s pytest.importorskip("paramiko") 352s E pytest.PytestDeprecationWarning: 352s E Module 'paramiko' was found, but when imported by pytest it raised: 352s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 352s E In pytest 9.1 this warning will become an error by default. 352s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 352s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 352s _________________ ERROR collecting protocol/tests/test_h5py.py _________________ 352s /usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py:8: in 352s h5py = pytest.importorskip("h5py") 352s E pytest.PytestDeprecationWarning: 352s E Module 'h5py' was found, but when imported by pytest it raised: 352s E ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 352s E In pytest 9.1 this warning will become an error by default. 352s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 352s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 352s =========================== short test summary info ============================ 352s ERROR cli/tests/test_dask_ssh.py - pytest.PytestDeprecationWarning: 352s Module 'paramiko' was found, but when imported by pytest it raised: 352s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 352s In pytest 9.1 this warning will become an error by default. 352s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 352s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 352s ERROR deploy/tests/test_old_ssh.py - pytest.PytestDeprecationWarning: 352s Module 'paramiko' was found, but when imported by pytest it raised: 352s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 352s In pytest 9.1 this warning will become an error by default. 352s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 352s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 352s ERROR protocol/tests/test_h5py.py - pytest.PytestDeprecationWarning: 352s Module 'h5py' was found, but when imported by pytest it raised: 352s ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 352s In pytest 9.1 this warning will become an error by default. 352s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 352s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 352s !!!!!!!!!!!!!!!!!!! Interrupted: 3 errors during collection !!!!!!!!!!!!!!!!!!!! 352s ================= 25 skipped, 35 deselected, 3 errors in 8.94s ================= 353s *** END OF RUN 3: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 353s *** STARTING RUN 4: python3.13 -m pytest -m not avoid_ci --verbose --timeout-method=signal --timeout=300 --durations=20 --color=no --runslow --pyargs distributed -rfE --last-failed --last-failed-no-failures none --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures 354s ============================= test session starts ============================== 354s platform linux -- Python 3.13.0, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.13 354s cachedir: .pytest_cache 354s rootdir: /tmp/autopkgtest.Vx887U/autopkgtest_tmp 354s configfile: pyproject.toml 354s plugins: typeguard-4.4.1, timeout-2.3.1, rerunfailures-14.0, anyio-4.6.2 354s timeout: 300.0s 354s timeout method: signal 354s timeout func_only: False 362s collecting ... collected 3601 items / 3 errors / 35 deselected / 25 skipped / 3566 selected 362s run-last-failure: 3 known failures not in selected tests 362s 362s ==================================== ERRORS ==================================== 362s _________________ ERROR collecting cli/tests/test_dask_ssh.py __________________ 362s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_ssh.py:9: in 362s pytest.importorskip("paramiko") 362s E pytest.PytestDeprecationWarning: 362s E Module 'paramiko' was found, but when imported by pytest it raised: 362s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 362s E In pytest 9.1 this warning will become an error by default. 362s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 362s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 362s ________________ ERROR collecting deploy/tests/test_old_ssh.py _________________ 362s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py:7: in 362s pytest.importorskip("paramiko") 362s E pytest.PytestDeprecationWarning: 362s E Module 'paramiko' was found, but when imported by pytest it raised: 362s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 362s E In pytest 9.1 this warning will become an error by default. 362s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 362s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 362s _________________ ERROR collecting protocol/tests/test_h5py.py _________________ 362s /usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py:8: in 362s h5py = pytest.importorskip("h5py") 362s E pytest.PytestDeprecationWarning: 362s E Module 'h5py' was found, but when imported by pytest it raised: 362s E ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 362s E In pytest 9.1 this warning will become an error by default. 362s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 362s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 362s =========================== short test summary info ============================ 362s ERROR cli/tests/test_dask_ssh.py - pytest.PytestDeprecationWarning: 362s Module 'paramiko' was found, but when imported by pytest it raised: 362s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 362s In pytest 9.1 this warning will become an error by default. 362s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 362s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 362s ERROR deploy/tests/test_old_ssh.py - pytest.PytestDeprecationWarning: 362s Module 'paramiko' was found, but when imported by pytest it raised: 362s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 362s In pytest 9.1 this warning will become an error by default. 362s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 362s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 362s ERROR protocol/tests/test_h5py.py - pytest.PytestDeprecationWarning: 362s Module 'h5py' was found, but when imported by pytest it raised: 362s ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 362s In pytest 9.1 this warning will become an error by default. 362s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 362s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 362s !!!!!!!!!!!!!!!!!!! Interrupted: 3 errors during collection !!!!!!!!!!!!!!!!!!!! 362s ================= 25 skipped, 35 deselected, 3 errors in 8.67s ================= 363s *** END OF RUN 4: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 363s *** STARTING RUN 5: python3.13 -m pytest -m not avoid_ci --verbose --timeout-method=signal --timeout=300 --durations=20 --color=no --runslow --pyargs distributed -rfE --last-failed --last-failed-no-failures none --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures 364s ============================= test session starts ============================== 364s platform linux -- Python 3.13.0, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.13 364s cachedir: .pytest_cache 364s rootdir: /tmp/autopkgtest.Vx887U/autopkgtest_tmp 364s configfile: pyproject.toml 364s plugins: typeguard-4.4.1, timeout-2.3.1, rerunfailures-14.0, anyio-4.6.2 364s timeout: 300.0s 364s timeout method: signal 364s timeout func_only: False 373s collecting ... collected 3601 items / 3 errors / 35 deselected / 25 skipped / 3566 selected 373s run-last-failure: 3 known failures not in selected tests 373s 373s ==================================== ERRORS ==================================== 373s _________________ ERROR collecting cli/tests/test_dask_ssh.py __________________ 373s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_ssh.py:9: in 373s pytest.importorskip("paramiko") 373s E pytest.PytestDeprecationWarning: 373s E Module 'paramiko' was found, but when imported by pytest it raised: 373s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 373s E In pytest 9.1 this warning will become an error by default. 373s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 373s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 373s ________________ ERROR collecting deploy/tests/test_old_ssh.py _________________ 373s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py:7: in 373s pytest.importorskip("paramiko") 373s E pytest.PytestDeprecationWarning: 373s E Module 'paramiko' was found, but when imported by pytest it raised: 373s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 373s E In pytest 9.1 this warning will become an error by default. 373s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 373s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 373s _________________ ERROR collecting protocol/tests/test_h5py.py _________________ 373s /usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py:8: in 373s h5py = pytest.importorskip("h5py") 373s E pytest.PytestDeprecationWarning: 373s E Module 'h5py' was found, but when imported by pytest it raised: 373s E ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 373s E In pytest 9.1 this warning will become an error by default. 373s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 373s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 373s =========================== short test summary info ============================ 373s ERROR cli/tests/test_dask_ssh.py - pytest.PytestDeprecationWarning: 373s Module 'paramiko' was found, but when imported by pytest it raised: 373s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 373s In pytest 9.1 this warning will become an error by default. 373s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 373s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 373s ERROR deploy/tests/test_old_ssh.py - pytest.PytestDeprecationWarning: 373s Module 'paramiko' was found, but when imported by pytest it raised: 373s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 373s In pytest 9.1 this warning will become an error by default. 373s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 373s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 373s ERROR protocol/tests/test_h5py.py - pytest.PytestDeprecationWarning: 373s Module 'h5py' was found, but when imported by pytest it raised: 373s ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 373s In pytest 9.1 this warning will become an error by default. 373s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 373s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 373s !!!!!!!!!!!!!!!!!!! Interrupted: 3 errors during collection !!!!!!!!!!!!!!!!!!!! 373s ================= 25 skipped, 35 deselected, 3 errors in 8.97s ================= 374s *** END OF RUN 5: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 374s *** SOME TESTS FAILED/ERRORED EVERY RUN, ABORTING *** 374s autopkgtest [00:23:45]: test pytest: -----------------------] 375s pytest FLAKY non-zero exit status 1 375s autopkgtest [00:23:46]: test pytest: - - - - - - - - - - results - - - - - - - - - - 375s autopkgtest [00:23:46]: test pybuild-autopkgtest: preparing testbed 448s autopkgtest [00:24:59]: testbed dpkg architecture: arm64 448s autopkgtest [00:24:59]: testbed apt version: 2.9.8 448s autopkgtest [00:24:59]: @@@@@@@@@@@@@@@@@@@@ test bed setup 449s Get:1 http://ftpmaster.internal/ubuntu plucky-proposed InRelease [73.9 kB] 449s Get:2 http://ftpmaster.internal/ubuntu plucky-proposed/multiverse Sources [13.6 kB] 449s Get:3 http://ftpmaster.internal/ubuntu plucky-proposed/restricted Sources [9704 B] 449s Get:4 http://ftpmaster.internal/ubuntu plucky-proposed/main Sources [49.1 kB] 449s Get:5 http://ftpmaster.internal/ubuntu plucky-proposed/universe Sources [892 kB] 449s Get:6 http://ftpmaster.internal/ubuntu plucky-proposed/main arm64 Packages [74.7 kB] 449s Get:7 http://ftpmaster.internal/ubuntu plucky-proposed/restricted arm64 Packages [57.8 kB] 449s Get:8 http://ftpmaster.internal/ubuntu plucky-proposed/universe arm64 Packages [748 kB] 450s Get:9 http://ftpmaster.internal/ubuntu plucky-proposed/multiverse arm64 Packages [19.3 kB] 450s Fetched 1938 kB in 1s (2139 kB/s) 450s Reading package lists... 452s Reading package lists... 453s Building dependency tree... 453s Reading state information... 454s Calculating upgrade... 455s The following package was automatically installed and is no longer required: 455s libsgutils2-1.46-2 455s Use 'sudo apt autoremove' to remove it. 455s The following NEW packages will be installed: 455s libsgutils2-1.48 455s The following packages will be upgraded: 455s bash bpftrace curl debconf debconf-i18n distro-info dracut-install 455s fwupd-signed gir1.2-girepository-2.0 gir1.2-glib-2.0 hostname init 455s init-system-helpers libaudit-common libaudit1 libcurl3t64-gnutls libcurl4t64 455s libgirepository-1.0-1 libglib2.0-0t64 libglib2.0-data liblzma5 455s libpam-modules libpam-modules-bin libpam-runtime libpam0g libplymouth5 455s libpython3-stdlib libselinux1 libsemanage-common libsemanage2 linux-base 455s lxd-installer openssh-client openssh-server openssh-sftp-server 455s pinentry-curses plymouth plymouth-theme-ubuntu-text python3 python3-blinker 455s python3-dbus python3-debconf python3-gi python3-jsonschema-specifications 455s python3-minimal python3-rpds-py python3-yaml sg3-utils sg3-utils-udev 455s vim-common vim-tiny xxd xz-utils 455s 53 upgraded, 1 newly installed, 0 to remove and 0 not upgraded. 455s Need to get 12.2 MB of archives. 455s After this operation, 2953 kB of additional disk space will be used. 455s Get:1 http://ftpmaster.internal/ubuntu plucky/main arm64 bash arm64 5.2.32-1ubuntu2 [791 kB] 456s Get:2 http://ftpmaster.internal/ubuntu plucky/main arm64 hostname arm64 3.25 [11.0 kB] 456s Get:3 http://ftpmaster.internal/ubuntu plucky/main arm64 init-system-helpers all 1.67ubuntu1 [39.1 kB] 456s Get:4 http://ftpmaster.internal/ubuntu plucky/main arm64 libaudit-common all 1:4.0.2-2ubuntu1 [6578 B] 456s Get:5 http://ftpmaster.internal/ubuntu plucky/main arm64 libaudit1 arm64 1:4.0.2-2ubuntu1 [54.2 kB] 456s Get:6 http://ftpmaster.internal/ubuntu plucky/main arm64 debconf-i18n all 1.5.87ubuntu1 [204 kB] 456s Get:7 http://ftpmaster.internal/ubuntu plucky-proposed/main arm64 python3-minimal arm64 3.12.7-1 [27.4 kB] 456s Get:8 http://ftpmaster.internal/ubuntu plucky-proposed/main arm64 python3 arm64 3.12.7-1 [24.0 kB] 456s Get:9 http://ftpmaster.internal/ubuntu plucky-proposed/main arm64 libpython3-stdlib arm64 3.12.7-1 [10.0 kB] 456s Get:10 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-debconf all 1.5.87ubuntu1 [4156 B] 456s Get:11 http://ftpmaster.internal/ubuntu plucky/main arm64 debconf all 1.5.87ubuntu1 [124 kB] 456s Get:12 http://ftpmaster.internal/ubuntu plucky/main arm64 libpam0g arm64 1.5.3-7ubuntu4 [68.6 kB] 456s Get:13 http://ftpmaster.internal/ubuntu plucky/main arm64 libselinux1 arm64 3.7-3ubuntu1 [81.6 kB] 456s Get:14 http://ftpmaster.internal/ubuntu plucky/main arm64 libpam-modules-bin arm64 1.5.3-7ubuntu4 [50.4 kB] 456s Get:15 http://ftpmaster.internal/ubuntu plucky/main arm64 libpam-modules arm64 1.5.3-7ubuntu4 [285 kB] 456s Get:16 http://ftpmaster.internal/ubuntu plucky/main arm64 init arm64 1.67ubuntu1 [6428 B] 456s Get:17 http://ftpmaster.internal/ubuntu plucky/main arm64 openssh-sftp-server arm64 1:9.9p1-3ubuntu2 [36.8 kB] 456s Get:18 http://ftpmaster.internal/ubuntu plucky/main arm64 openssh-server arm64 1:9.9p1-3ubuntu2 [524 kB] 456s Get:19 http://ftpmaster.internal/ubuntu plucky/main arm64 openssh-client arm64 1:9.9p1-3ubuntu2 [920 kB] 456s Get:20 http://ftpmaster.internal/ubuntu plucky/main arm64 libpam-runtime all 1.5.3-7ubuntu4 [40.8 kB] 456s Get:21 http://ftpmaster.internal/ubuntu plucky/main arm64 liblzma5 arm64 5.6.3-1 [138 kB] 456s Get:22 http://ftpmaster.internal/ubuntu plucky/main arm64 libsemanage-common all 3.7-2build1 [7186 B] 456s Get:23 http://ftpmaster.internal/ubuntu plucky/main arm64 libsemanage2 arm64 3.7-2build1 [92.2 kB] 456s Get:24 http://ftpmaster.internal/ubuntu plucky/main arm64 distro-info arm64 1.12 [19.4 kB] 456s Get:25 http://ftpmaster.internal/ubuntu plucky/main arm64 gir1.2-girepository-2.0 arm64 1.82.0-2 [25.2 kB] 456s Get:26 http://ftpmaster.internal/ubuntu plucky/main arm64 gir1.2-glib-2.0 arm64 2.82.2-3 [182 kB] 456s Get:27 http://ftpmaster.internal/ubuntu plucky/main arm64 libglib2.0-0t64 arm64 2.82.2-3 [1560 kB] 456s Get:28 http://ftpmaster.internal/ubuntu plucky/main arm64 libgirepository-1.0-1 arm64 1.82.0-2 [83.0 kB] 456s Get:29 http://ftpmaster.internal/ubuntu plucky/main arm64 libglib2.0-data all 2.82.2-3 [51.7 kB] 456s Get:30 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-dbus arm64 1.3.2-5build4 [109 kB] 456s Get:31 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-gi arm64 3.50.0-3build1 [279 kB] 456s Get:32 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-yaml arm64 6.0.2-1build1 [164 kB] 456s Get:33 http://ftpmaster.internal/ubuntu plucky/main arm64 vim-tiny arm64 2:9.1.0861-1ubuntu1 [805 kB] 456s Get:34 http://ftpmaster.internal/ubuntu plucky/main arm64 vim-common all 2:9.1.0861-1ubuntu1 [395 kB] 456s Get:35 http://ftpmaster.internal/ubuntu plucky/main arm64 xxd arm64 2:9.1.0861-1ubuntu1 [67.3 kB] 456s Get:36 http://ftpmaster.internal/ubuntu plucky/main arm64 libplymouth5 arm64 24.004.60-2ubuntu3 [141 kB] 456s Get:37 http://ftpmaster.internal/ubuntu plucky/main arm64 plymouth-theme-ubuntu-text arm64 24.004.60-2ubuntu3 [9914 B] 456s Get:38 http://ftpmaster.internal/ubuntu plucky/main arm64 plymouth arm64 24.004.60-2ubuntu3 [135 kB] 456s Get:39 http://ftpmaster.internal/ubuntu plucky/main arm64 xz-utils arm64 5.6.3-1 [272 kB] 456s Get:40 http://ftpmaster.internal/ubuntu plucky/main arm64 bpftrace arm64 0.21.2-2ubuntu3 [1854 kB] 456s Get:41 http://ftpmaster.internal/ubuntu plucky/main arm64 curl arm64 8.9.1-2ubuntu3 [235 kB] 456s Get:42 http://ftpmaster.internal/ubuntu plucky/main arm64 libcurl4t64 arm64 8.9.1-2ubuntu3 [365 kB] 456s Get:43 http://ftpmaster.internal/ubuntu plucky/main arm64 dracut-install arm64 105-2ubuntu2 [34.7 kB] 456s Get:44 http://ftpmaster.internal/ubuntu plucky/main arm64 fwupd-signed arm64 1.55+1.7-1 [30.9 kB] 456s Get:45 http://ftpmaster.internal/ubuntu plucky/main arm64 libcurl3t64-gnutls arm64 8.9.1-2ubuntu3 [359 kB] 456s Get:46 http://ftpmaster.internal/ubuntu plucky/main arm64 libsgutils2-1.48 arm64 1.48-0ubuntu1 [118 kB] 456s Get:47 http://ftpmaster.internal/ubuntu plucky/main arm64 linux-base all 4.10.1ubuntu1 [34.8 kB] 456s Get:48 http://ftpmaster.internal/ubuntu plucky/main arm64 lxd-installer all 10 [5264 B] 456s Get:49 http://ftpmaster.internal/ubuntu plucky/main arm64 pinentry-curses arm64 1.3.1-0ubuntu2 [38.5 kB] 456s Get:50 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-blinker all 1.9.0-1 [10.7 kB] 456s Get:51 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-rpds-py arm64 0.21.0-2ubuntu1 [302 kB] 456s Get:52 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-jsonschema-specifications all 2023.12.1-2 [9116 B] 456s Get:53 http://ftpmaster.internal/ubuntu plucky/main arm64 sg3-utils arm64 1.48-0ubuntu1 [999 kB] 456s Get:54 http://ftpmaster.internal/ubuntu plucky/main arm64 sg3-utils-udev all 1.48-0ubuntu1 [6608 B] 457s Preconfiguring packages ... 457s Fetched 12.2 MB in 1s (10.0 MB/s) 457s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 457s Preparing to unpack .../bash_5.2.32-1ubuntu2_arm64.deb ... 457s Unpacking bash (5.2.32-1ubuntu2) over (5.2.32-1ubuntu1) ... 457s Setting up bash (5.2.32-1ubuntu2) ... 457s update-alternatives: using /usr/share/man/man7/bash-builtins.7.gz to provide /usr/share/man/man7/builtins.7.gz (builtins.7.gz) in auto mode 458s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 458s Preparing to unpack .../hostname_3.25_arm64.deb ... 458s Unpacking hostname (3.25) over (3.23+nmu2ubuntu2) ... 458s Setting up hostname (3.25) ... 458s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 458s Preparing to unpack .../init-system-helpers_1.67ubuntu1_all.deb ... 458s Unpacking init-system-helpers (1.67ubuntu1) over (1.66ubuntu1) ... 458s Setting up init-system-helpers (1.67ubuntu1) ... 458s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 458s Preparing to unpack .../libaudit-common_1%3a4.0.2-2ubuntu1_all.deb ... 458s Unpacking libaudit-common (1:4.0.2-2ubuntu1) over (1:4.0.1-1ubuntu2) ... 458s Setting up libaudit-common (1:4.0.2-2ubuntu1) ... 458s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 458s Preparing to unpack .../libaudit1_1%3a4.0.2-2ubuntu1_arm64.deb ... 458s Unpacking libaudit1:arm64 (1:4.0.2-2ubuntu1) over (1:4.0.1-1ubuntu2) ... 458s Setting up libaudit1:arm64 (1:4.0.2-2ubuntu1) ... 458s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 458s Preparing to unpack .../debconf-i18n_1.5.87ubuntu1_all.deb ... 458s Unpacking debconf-i18n (1.5.87ubuntu1) over (1.5.86ubuntu1) ... 458s Preparing to unpack .../python3-minimal_3.12.7-1_arm64.deb ... 458s Unpacking python3-minimal (3.12.7-1) over (3.12.6-0ubuntu1) ... 458s Setting up python3-minimal (3.12.7-1) ... 458s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 458s Preparing to unpack .../python3_3.12.7-1_arm64.deb ... 459s Unpacking python3 (3.12.7-1) over (3.12.6-0ubuntu1) ... 459s Preparing to unpack .../libpython3-stdlib_3.12.7-1_arm64.deb ... 459s Unpacking libpython3-stdlib:arm64 (3.12.7-1) over (3.12.6-0ubuntu1) ... 459s Preparing to unpack .../python3-debconf_1.5.87ubuntu1_all.deb ... 459s Unpacking python3-debconf (1.5.87ubuntu1) over (1.5.86ubuntu1) ... 459s Preparing to unpack .../debconf_1.5.87ubuntu1_all.deb ... 459s Unpacking debconf (1.5.87ubuntu1) over (1.5.86ubuntu1) ... 459s Setting up debconf (1.5.87ubuntu1) ... 459s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 459s Preparing to unpack .../libpam0g_1.5.3-7ubuntu4_arm64.deb ... 459s Unpacking libpam0g:arm64 (1.5.3-7ubuntu4) over (1.5.3-7ubuntu2) ... 459s Setting up libpam0g:arm64 (1.5.3-7ubuntu4) ... 459s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 459s Preparing to unpack .../libselinux1_3.7-3ubuntu1_arm64.deb ... 459s Unpacking libselinux1:arm64 (3.7-3ubuntu1) over (3.5-2ubuntu5) ... 460s Setting up libselinux1:arm64 (3.7-3ubuntu1) ... 460s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 460s Preparing to unpack .../libpam-modules-bin_1.5.3-7ubuntu4_arm64.deb ... 460s Unpacking libpam-modules-bin (1.5.3-7ubuntu4) over (1.5.3-7ubuntu2) ... 460s Setting up libpam-modules-bin (1.5.3-7ubuntu4) ... 460s pam_namespace.service is a disabled or a static unit not running, not starting it. 460s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 460s Preparing to unpack .../libpam-modules_1.5.3-7ubuntu4_arm64.deb ... 460s Unpacking libpam-modules:arm64 (1.5.3-7ubuntu4) over (1.5.3-7ubuntu2) ... 460s Setting up libpam-modules:arm64 (1.5.3-7ubuntu4) ... 460s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80002 files and directories currently installed.) 460s Preparing to unpack .../init_1.67ubuntu1_arm64.deb ... 460s Unpacking init (1.67ubuntu1) over (1.66ubuntu1) ... 461s Preparing to unpack .../openssh-sftp-server_1%3a9.9p1-3ubuntu2_arm64.deb ... 461s Unpacking openssh-sftp-server (1:9.9p1-3ubuntu2) over (1:9.7p1-7ubuntu5) ... 461s Preparing to unpack .../openssh-server_1%3a9.9p1-3ubuntu2_arm64.deb ... 461s Unpacking openssh-server (1:9.9p1-3ubuntu2) over (1:9.7p1-7ubuntu5) ... 461s Preparing to unpack .../openssh-client_1%3a9.9p1-3ubuntu2_arm64.deb ... 461s Unpacking openssh-client (1:9.9p1-3ubuntu2) over (1:9.7p1-7ubuntu5) ... 461s Preparing to unpack .../libpam-runtime_1.5.3-7ubuntu4_all.deb ... 461s Unpacking libpam-runtime (1.5.3-7ubuntu4) over (1.5.3-7ubuntu2) ... 461s Setting up libpam-runtime (1.5.3-7ubuntu4) ... 461s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80004 files and directories currently installed.) 461s Preparing to unpack .../liblzma5_5.6.3-1_arm64.deb ... 461s Unpacking liblzma5:arm64 (5.6.3-1) over (5.6.2-2) ... 461s Setting up liblzma5:arm64 (5.6.3-1) ... 461s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80004 files and directories currently installed.) 461s Preparing to unpack .../libsemanage-common_3.7-2build1_all.deb ... 461s Unpacking libsemanage-common (3.7-2build1) over (3.5-1build6) ... 461s Setting up libsemanage-common (3.7-2build1) ... 462s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80003 files and directories currently installed.) 462s Preparing to unpack .../libsemanage2_3.7-2build1_arm64.deb ... 462s Unpacking libsemanage2:arm64 (3.7-2build1) over (3.5-1build6) ... 462s Setting up libsemanage2:arm64 (3.7-2build1) ... 462s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80003 files and directories currently installed.) 462s Preparing to unpack .../00-distro-info_1.12_arm64.deb ... 462s Unpacking distro-info (1.12) over (1.9) ... 462s Preparing to unpack .../01-gir1.2-girepository-2.0_1.82.0-2_arm64.deb ... 462s Unpacking gir1.2-girepository-2.0:arm64 (1.82.0-2) over (1.80.1-4) ... 462s Preparing to unpack .../02-gir1.2-glib-2.0_2.82.2-3_arm64.deb ... 462s Unpacking gir1.2-glib-2.0:arm64 (2.82.2-3) over (2.82.1-0ubuntu1) ... 462s Preparing to unpack .../03-libglib2.0-0t64_2.82.2-3_arm64.deb ... 462s Unpacking libglib2.0-0t64:arm64 (2.82.2-3) over (2.82.1-0ubuntu1) ... 462s Preparing to unpack .../04-libgirepository-1.0-1_1.82.0-2_arm64.deb ... 462s Unpacking libgirepository-1.0-1:arm64 (1.82.0-2) over (1.80.1-4) ... 462s Preparing to unpack .../05-libglib2.0-data_2.82.2-3_all.deb ... 462s Unpacking libglib2.0-data (2.82.2-3) over (2.82.1-0ubuntu1) ... 462s Preparing to unpack .../06-python3-dbus_1.3.2-5build4_arm64.deb ... 462s Unpacking python3-dbus (1.3.2-5build4) over (1.3.2-5build3) ... 462s Preparing to unpack .../07-python3-gi_3.50.0-3build1_arm64.deb ... 462s Unpacking python3-gi (3.50.0-3build1) over (3.50.0-3) ... 462s Preparing to unpack .../08-python3-yaml_6.0.2-1build1_arm64.deb ... 463s Unpacking python3-yaml (6.0.2-1build1) over (6.0.2-1) ... 463s Preparing to unpack .../09-vim-tiny_2%3a9.1.0861-1ubuntu1_arm64.deb ... 463s Unpacking vim-tiny (2:9.1.0861-1ubuntu1) over (2:9.1.0777-1ubuntu1) ... 463s Preparing to unpack .../10-vim-common_2%3a9.1.0861-1ubuntu1_all.deb ... 463s Unpacking vim-common (2:9.1.0861-1ubuntu1) over (2:9.1.0777-1ubuntu1) ... 463s Preparing to unpack .../11-xxd_2%3a9.1.0861-1ubuntu1_arm64.deb ... 463s Unpacking xxd (2:9.1.0861-1ubuntu1) over (2:9.1.0777-1ubuntu1) ... 463s Preparing to unpack .../12-libplymouth5_24.004.60-2ubuntu3_arm64.deb ... 463s Unpacking libplymouth5:arm64 (24.004.60-2ubuntu3) over (24.004.60-1ubuntu11) ... 463s Preparing to unpack .../13-plymouth-theme-ubuntu-text_24.004.60-2ubuntu3_arm64.deb ... 463s Unpacking plymouth-theme-ubuntu-text (24.004.60-2ubuntu3) over (24.004.60-1ubuntu11) ... 463s Preparing to unpack .../14-plymouth_24.004.60-2ubuntu3_arm64.deb ... 463s Unpacking plymouth (24.004.60-2ubuntu3) over (24.004.60-1ubuntu11) ... 463s Preparing to unpack .../15-xz-utils_5.6.3-1_arm64.deb ... 463s Unpacking xz-utils (5.6.3-1) over (5.6.2-2) ... 463s Preparing to unpack .../16-bpftrace_0.21.2-2ubuntu3_arm64.deb ... 463s Unpacking bpftrace (0.21.2-2ubuntu3) over (0.21.2-2ubuntu2) ... 463s Preparing to unpack .../17-curl_8.9.1-2ubuntu3_arm64.deb ... 463s Unpacking curl (8.9.1-2ubuntu3) over (8.9.1-2ubuntu2) ... 463s Preparing to unpack .../18-libcurl4t64_8.9.1-2ubuntu3_arm64.deb ... 463s Unpacking libcurl4t64:arm64 (8.9.1-2ubuntu3) over (8.9.1-2ubuntu2) ... 464s Preparing to unpack .../19-dracut-install_105-2ubuntu2_arm64.deb ... 464s Unpacking dracut-install (105-2ubuntu2) over (105-1ubuntu1) ... 464s Preparing to unpack .../20-fwupd-signed_1.55+1.7-1_arm64.deb ... 464s Unpacking fwupd-signed (1.55+1.7-1) over (1.54+1.6-1build1) ... 464s Preparing to unpack .../21-libcurl3t64-gnutls_8.9.1-2ubuntu3_arm64.deb ... 464s Unpacking libcurl3t64-gnutls:arm64 (8.9.1-2ubuntu3) over (8.9.1-2ubuntu2) ... 464s Selecting previously unselected package libsgutils2-1.48:arm64. 464s Preparing to unpack .../22-libsgutils2-1.48_1.48-0ubuntu1_arm64.deb ... 464s Unpacking libsgutils2-1.48:arm64 (1.48-0ubuntu1) ... 464s Preparing to unpack .../23-linux-base_4.10.1ubuntu1_all.deb ... 464s Unpacking linux-base (4.10.1ubuntu1) over (4.5ubuntu9) ... 464s Preparing to unpack .../24-lxd-installer_10_all.deb ... 464s Unpacking lxd-installer (10) over (9) ... 464s Preparing to unpack .../25-pinentry-curses_1.3.1-0ubuntu2_arm64.deb ... 464s Unpacking pinentry-curses (1.3.1-0ubuntu2) over (1.2.1-3ubuntu5) ... 464s Preparing to unpack .../26-python3-blinker_1.9.0-1_all.deb ... 465s Unpacking python3-blinker (1.9.0-1) over (1.8.2-1) ... 465s Preparing to unpack .../27-python3-rpds-py_0.21.0-2ubuntu1_arm64.deb ... 465s Unpacking python3-rpds-py (0.21.0-2ubuntu1) over (0.20.0-0ubuntu3) ... 465s Preparing to unpack .../28-python3-jsonschema-specifications_2023.12.1-2_all.deb ... 465s Unpacking python3-jsonschema-specifications (2023.12.1-2) over (2023.12.1-1ubuntu1) ... 465s Preparing to unpack .../29-sg3-utils_1.48-0ubuntu1_arm64.deb ... 465s Unpacking sg3-utils (1.48-0ubuntu1) over (1.46-3ubuntu5) ... 465s Preparing to unpack .../30-sg3-utils-udev_1.48-0ubuntu1_all.deb ... 465s Unpacking sg3-utils-udev (1.48-0ubuntu1) over (1.46-3ubuntu5) ... 465s Setting up pinentry-curses (1.3.1-0ubuntu2) ... 465s Setting up distro-info (1.12) ... 465s Setting up linux-base (4.10.1ubuntu1) ... 465s Setting up init (1.67ubuntu1) ... 465s Setting up libcurl4t64:arm64 (8.9.1-2ubuntu3) ... 465s Setting up bpftrace (0.21.2-2ubuntu3) ... 465s Setting up openssh-client (1:9.9p1-3ubuntu2) ... 465s Setting up libcurl3t64-gnutls:arm64 (8.9.1-2ubuntu3) ... 465s Setting up fwupd-signed (1.55+1.7-1) ... 465s Setting up libsgutils2-1.48:arm64 (1.48-0ubuntu1) ... 465s Setting up debconf-i18n (1.5.87ubuntu1) ... 465s Setting up xxd (2:9.1.0861-1ubuntu1) ... 465s Setting up libglib2.0-0t64:arm64 (2.82.2-3) ... 465s No schema files found: doing nothing. 465s Setting up libglib2.0-data (2.82.2-3) ... 465s Setting up vim-common (2:9.1.0861-1ubuntu1) ... 465s Setting up xz-utils (5.6.3-1) ... 465s Setting up gir1.2-glib-2.0:arm64 (2.82.2-3) ... 465s Setting up lxd-installer (10) ... 465s Setting up dracut-install (105-2ubuntu2) ... 465s Setting up libplymouth5:arm64 (24.004.60-2ubuntu3) ... 465s Setting up libgirepository-1.0-1:arm64 (1.82.0-2) ... 465s Setting up curl (8.9.1-2ubuntu3) ... 465s Setting up libpython3-stdlib:arm64 (3.12.7-1) ... 465s Setting up sg3-utils (1.48-0ubuntu1) ... 465s Setting up openssh-sftp-server (1:9.9p1-3ubuntu2) ... 465s Setting up openssh-server (1:9.9p1-3ubuntu2) ... 465s Installing new version of config file /etc/ssh/moduli ... 466s Replacing config file /etc/ssh/sshd_config with new version 467s Setting up plymouth (24.004.60-2ubuntu3) ... 467s update-initramfs: Generating /boot/initrd.img-6.11.0-8-generic 467s W: No lz4 in /usr/bin:/sbin:/bin, using gzip 489s flash-kernel: deferring update (trigger activated) 489s update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults 489s update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults 489s Setting up python3 (3.12.7-1) ... 490s Setting up vim-tiny (2:9.1.0861-1ubuntu1) ... 490s Setting up sg3-utils-udev (1.48-0ubuntu1) ... 490s update-initramfs: deferring update (trigger activated) 490s Setting up plymouth-theme-ubuntu-text (24.004.60-2ubuntu3) ... 490s update-initramfs: deferring update (trigger activated) 490s Setting up gir1.2-girepository-2.0:arm64 (1.82.0-2) ... 490s Setting up python3-gi (3.50.0-3build1) ... 490s Setting up python3-rpds-py (0.21.0-2ubuntu1) ... 490s Setting up python3-jsonschema-specifications (2023.12.1-2) ... 490s Setting up python3-blinker (1.9.0-1) ... 491s Setting up python3-dbus (1.3.2-5build4) ... 491s Setting up python3-debconf (1.5.87ubuntu1) ... 491s Setting up python3-yaml (6.0.2-1build1) ... 491s Processing triggers for man-db (2.13.0-1) ... 493s Processing triggers for debianutils (5.21) ... 493s Processing triggers for install-info (7.1.1-1) ... 493s Processing triggers for initramfs-tools (0.142ubuntu35) ... 493s update-initramfs: Generating /boot/initrd.img-6.11.0-8-generic 493s W: No lz4 in /usr/bin:/sbin:/bin, using gzip 510s System running in EFI mode, skipping. 510s Processing triggers for libc-bin (2.40-1ubuntu3) ... 510s Processing triggers for ufw (0.36.2-8) ... 510s Processing triggers for flash-kernel (3.107ubuntu13) ... 511s System running in EFI mode, skipping. 511s Reading package lists... 511s Building dependency tree... 511s Reading state information... 512s The following packages will be REMOVED: 512s libsgutils2-1.46-2* 512s 0 upgraded, 0 newly installed, 1 to remove and 0 not upgraded. 512s After this operation, 314 kB disk space will be freed. 512s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80037 files and directories currently installed.) 512s Removing libsgutils2-1.46-2:arm64 (1.46-3ubuntu5) ... 512s Processing triggers for libc-bin (2.40-1ubuntu3) ... 513s Hit:1 http://ftpmaster.internal/ubuntu plucky-proposed InRelease 513s Hit:2 http://ftpmaster.internal/ubuntu plucky InRelease 513s Hit:3 http://ftpmaster.internal/ubuntu plucky-updates InRelease 513s Hit:4 http://ftpmaster.internal/ubuntu plucky-security InRelease 515s Reading package lists... 515s Reading package lists... 515s Building dependency tree... 515s Reading state information... 516s Calculating upgrade... 516s 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 516s Reading package lists... 516s Building dependency tree... 516s Reading state information... 517s 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 517s autopkgtest [00:26:08]: rebooting testbed after setup commands that affected boot 521s autopkgtest-virt-ssh: WARNING: ssh connection failed. Retrying in 3 seconds... 547s Reading package lists... 547s Building dependency tree... 547s Reading state information... 547s Starting pkgProblemResolver with broken count: 0 548s Starting 2 pkgProblemResolver with broken count: 0 548s Done 548s The following additional packages will be installed: 548s autoconf automake autopoint autotools-dev build-essential cpp cpp-14 548s cpp-14-aarch64-linux-gnu cpp-aarch64-linux-gnu debhelper debugedit 548s dh-autoreconf dh-python dh-strip-nondeterminism docutils-common dwz 548s fonts-font-awesome fonts-glyphicons-halflings fonts-lato fonts-mathjax g++ 548s g++-14 g++-14-aarch64-linux-gnu g++-aarch64-linux-gnu gcc gcc-14 548s gcc-14-aarch64-linux-gnu gcc-aarch64-linux-gnu gettext intltool-debian 548s libarchive-zip-perl libargon2-1 libasan8 libblas3 libcares2 libcc1-0 548s libdebhelper-perl libfile-stripnondeterminism-perl libgcc-14-dev 548s libgfortran5 libgomp1 libhwasan0 libisl23 libitm1 libjs-bootstrap 548s libjs-jquery libjs-mathjax libjs-sortable-tablesort libjs-sphinxdoc 548s libjs-sprintf-js libjs-underscore libjson-perl liblapack3 liblsan0 libmpc3 548s libnode115 libnorm1t64 libpgm-5.3-0t64 libpython3.13-minimal 548s libpython3.13-stdlib libsodium23 libstdc++-14-dev libtool libtsan2 libubsan1 548s libzmq5 m4 node-acorn node-argparse node-balanced-match node-brace-expansion 548s node-cjs-module-lexer node-esprima node-js-yaml node-minimatch 548s node-sprintf-js node-uglify-js node-undici node-xtend nodejs po-debconf 548s pybuild-plugin-autopkgtest pybuild-plugin-pyproject python-dask-doc 548s python-distributed-doc python-fsspec-doc python-numpy-doc python-pandas-doc 548s python-tinycss2-common python3-alabaster python3-all python3-anyio 548s python3-argon2 python3-arrow python3-async-generator python3-bleach 548s python3-bs4 python3-build python3-click python3-cloudpickle python3-colorama 548s python3-dask python3-dask-sphinx-theme python3-dateutil python3-decorator 548s python3-defusedxml python3-distributed python3-doc python3-docutils 548s python3-fastjsonschema python3-fqdn python3-fsspec python3-html5lib 548s python3-imagesize python3-iniconfig python3-installer python3-isoduration 548s python3-jupyter-client python3-jupyter-core python3-jupyter-events 548s python3-jupyter-server python3-jupyter-server-terminals 548s python3-jupyterlab-pygments python3-locket python3-mistune python3-msgpack 548s python3-nbclient python3-nbconvert python3-nbformat python3-numpy 548s python3-numpydoc python3-overrides python3-packaging python3-pandas 548s python3-pandas-lib python3-pandocfilters python3-partd python3-platformdirs 548s python3-pluggy python3-prometheus-client python3-psutil python3-ptyprocess 548s python3-py python3-pydata-sphinx-theme python3-pyproject-hooks 548s python3-pytest python3-pytest-asyncio python3-pytest-rerunfailures 548s python3-pytest-timeout python3-pythonjsonlogger python3-rfc3339-validator 548s python3-rfc3986-validator python3-roman python3-send2trash python3-sniffio 548s python3-snowballstemmer python3-sortedcollections python3-sortedcontainers 548s python3-soupsieve python3-sphinx python3-sphinx-book-theme 548s python3-sphinx-click python3-sphinx-design python3-tabulate python3-tblib 548s python3-terminado python3-tinycss2 python3-toml python3-toolz 548s python3-tornado python3-traitlets python3-tz python3-uritemplate 548s python3-versioneer python3-webcolors python3-webencodings python3-websocket 548s python3-wheel python3-zict python3-zmq python3.12-doc python3.13 548s python3.13-minimal sass-stylesheets-bulma sgml-base sphinx-common 548s sphinx-rtd-theme-common tzdata-legacy uglifyjs xml-core 548s Suggested packages: 548s autoconf-archive gnu-standards autoconf-doc cpp-doc gcc-14-locales 548s cpp-14-doc dh-make flit gcc-14-doc gcc-multilib manpages-dev flex bison gdb 548s gcc-doc gdb-aarch64-linux-gnu gettext-doc libasprintf-dev libgettextpo-dev 548s fonts-mathjax-extras fonts-stix libjs-mathjax-doc libjs-angularjs 548s libstdc++-14-doc libtool-doc gfortran | fortran95-compiler gcj-jdk m4-doc 548s javascript-common npm node-corepack libmail-box-perl python-imageio-doc 548s python-pytest-doc python-scipy-doc python-skimage-doc python-argon2-doc 548s python-arrow-doc python-bleach-doc python3-pip python3-venv python-build-doc 548s ipython python3-blosc python3-boto3 python3-graphviz python3-h5py 548s python3-scipy python3-skimage python3-sklearn python3-sqlalchemy 548s python3-tables python3-examples docutils-doc fonts-linuxlibertine 548s | ttf-linux-libertine texlive-lang-french texlive-latex-base 548s texlive-latex-recommended python-fastjsonschema-doc python3-genshi 548s python3-lxml python-installer-doc python-jupyter-client-doc 548s python-jupyter-events-doc python-jupyter-server-doc python-nbconvert-doc 548s texlive-fonts-recommended texlive-plain-generic texlive-xetex gfortran 548s python3-dev python3-statsmodels subversion python3-stemmer 548s python-sortedcontainers-doc dvipng dvisvgm fonts-freefont-otf 548s imagemagick-6.q16 latexmk python3-sphinx-rtd-theme sphinx-doc tex-gyre 548s texlive-fonts-extra texlive-latex-extra python-sphinx-click-doc 548s python-terminado-doc python-tinycss2-doc python-toolz-doc python3-pycurl 548s python-tornado-doc python3-twisted python-traitlets-doc 548s python-python-versioneer-doc python3.13-venv python3.13-doc binfmt-support 548s sgml-base-doc 548s Recommended packages: 548s libarchive-cpio-perl javascript-common libjson-xs-perl libltdl-dev 548s nodejs-doc libmail-sendmail-perl python3-lxml libpaper-utils python3-pil git 548s python3-dropbox python3-fusepy python3-libarchive-c python3-paramiko 548s python3-pygit2 pandoc python3-scipy python3-matplotlib python3-bottleneck 548s python3-numexpr python3-odf python3-openpyxl python3-tables python3-blosc 548s python3-accessible-pygments 548s The following NEW packages will be installed: 548s autoconf automake autopkgtest-satdep autopoint autotools-dev build-essential 548s cpp cpp-14 cpp-14-aarch64-linux-gnu cpp-aarch64-linux-gnu debhelper 548s debugedit dh-autoreconf dh-python dh-strip-nondeterminism docutils-common 548s dwz fonts-font-awesome fonts-glyphicons-halflings fonts-lato fonts-mathjax 548s g++ g++-14 g++-14-aarch64-linux-gnu g++-aarch64-linux-gnu gcc gcc-14 548s gcc-14-aarch64-linux-gnu gcc-aarch64-linux-gnu gettext intltool-debian 548s libarchive-zip-perl libargon2-1 libasan8 libblas3 libcares2 libcc1-0 548s libdebhelper-perl libfile-stripnondeterminism-perl libgcc-14-dev 548s libgfortran5 libgomp1 libhwasan0 libisl23 libitm1 libjs-bootstrap 548s libjs-jquery libjs-mathjax libjs-sortable-tablesort libjs-sphinxdoc 548s libjs-sprintf-js libjs-underscore libjson-perl liblapack3 liblsan0 libmpc3 548s libnode115 libnorm1t64 libpgm-5.3-0t64 libpython3.13-minimal 548s libpython3.13-stdlib libsodium23 libstdc++-14-dev libtool libtsan2 libubsan1 548s libzmq5 m4 node-acorn node-argparse node-balanced-match node-brace-expansion 548s node-cjs-module-lexer node-esprima node-js-yaml node-minimatch 548s node-sprintf-js node-uglify-js node-undici node-xtend nodejs po-debconf 548s pybuild-plugin-autopkgtest pybuild-plugin-pyproject python-dask-doc 548s python-distributed-doc python-fsspec-doc python-numpy-doc python-pandas-doc 548s python-tinycss2-common python3-alabaster python3-all python3-anyio 548s python3-argon2 python3-arrow python3-async-generator python3-bleach 548s python3-bs4 python3-build python3-click python3-cloudpickle python3-colorama 548s python3-dask python3-dask-sphinx-theme python3-dateutil python3-decorator 548s python3-defusedxml python3-distributed python3-doc python3-docutils 548s python3-fastjsonschema python3-fqdn python3-fsspec python3-html5lib 548s python3-imagesize python3-iniconfig python3-installer python3-isoduration 548s python3-jupyter-client python3-jupyter-core python3-jupyter-events 548s python3-jupyter-server python3-jupyter-server-terminals 548s python3-jupyterlab-pygments python3-locket python3-mistune python3-msgpack 548s python3-nbclient python3-nbconvert python3-nbformat python3-numpy 548s python3-numpydoc python3-overrides python3-packaging python3-pandas 548s python3-pandas-lib python3-pandocfilters python3-partd python3-platformdirs 548s python3-pluggy python3-prometheus-client python3-psutil python3-ptyprocess 548s python3-py python3-pydata-sphinx-theme python3-pyproject-hooks 548s python3-pytest python3-pytest-asyncio python3-pytest-rerunfailures 548s python3-pytest-timeout python3-pythonjsonlogger python3-rfc3339-validator 548s python3-rfc3986-validator python3-roman python3-send2trash python3-sniffio 548s python3-snowballstemmer python3-sortedcollections python3-sortedcontainers 548s python3-soupsieve python3-sphinx python3-sphinx-book-theme 548s python3-sphinx-click python3-sphinx-design python3-tabulate python3-tblib 548s python3-terminado python3-tinycss2 python3-toml python3-toolz 548s python3-tornado python3-traitlets python3-tz python3-uritemplate 548s python3-versioneer python3-webcolors python3-webencodings python3-websocket 548s python3-wheel python3-zict python3-zmq python3.12-doc python3.13 548s python3.13-minimal sass-stylesheets-bulma sgml-base sphinx-common 548s sphinx-rtd-theme-common tzdata-legacy uglifyjs xml-core 548s 0 upgraded, 191 newly installed, 0 to remove and 0 not upgraded. 548s Need to get 165 MB/165 MB of archives. 548s After this operation, 1003 MB of additional disk space will be used. 548s Get:1 /tmp/autopkgtest.Vx887U/2-autopkgtest-satdep.deb autopkgtest-satdep arm64 0 [1100 B] 549s Get:2 http://ftpmaster.internal/ubuntu plucky/main arm64 fonts-lato all 2.015-1 [2781 kB] 549s Get:3 http://ftpmaster.internal/ubuntu plucky/main arm64 libpython3.13-minimal arm64 3.13.0-2 [877 kB] 549s Get:4 http://ftpmaster.internal/ubuntu plucky/main arm64 python3.13-minimal arm64 3.13.0-2 [2100 kB] 549s Get:5 http://ftpmaster.internal/ubuntu plucky/main arm64 sgml-base all 1.31 [11.4 kB] 549s Get:6 http://ftpmaster.internal/ubuntu plucky/main arm64 m4 arm64 1.4.19-4build1 [240 kB] 549s Get:7 http://ftpmaster.internal/ubuntu plucky/main arm64 autoconf all 2.72-3 [382 kB] 549s Get:8 http://ftpmaster.internal/ubuntu plucky/main arm64 autotools-dev all 20220109.1 [44.9 kB] 549s Get:9 http://ftpmaster.internal/ubuntu plucky/main arm64 automake all 1:1.16.5-1.3ubuntu1 [558 kB] 549s Get:10 http://ftpmaster.internal/ubuntu plucky/main arm64 autopoint all 0.22.5-2 [616 kB] 549s Get:11 http://ftpmaster.internal/ubuntu plucky/main arm64 libisl23 arm64 0.27-1 [676 kB] 549s Get:12 http://ftpmaster.internal/ubuntu plucky/main arm64 libmpc3 arm64 1.3.1-1build2 [56.8 kB] 549s Get:13 http://ftpmaster.internal/ubuntu plucky/main arm64 cpp-14-aarch64-linux-gnu arm64 14.2.0-8ubuntu1 [10.6 MB] 550s Get:14 http://ftpmaster.internal/ubuntu plucky/main arm64 cpp-14 arm64 14.2.0-8ubuntu1 [1028 B] 550s Get:15 http://ftpmaster.internal/ubuntu plucky/main arm64 cpp-aarch64-linux-gnu arm64 4:14.1.0-2ubuntu1 [5452 B] 550s Get:16 http://ftpmaster.internal/ubuntu plucky/main arm64 cpp arm64 4:14.1.0-2ubuntu1 [22.5 kB] 550s Get:17 http://ftpmaster.internal/ubuntu plucky/main arm64 libcc1-0 arm64 14.2.0-8ubuntu1 [49.7 kB] 550s Get:18 http://ftpmaster.internal/ubuntu plucky/main arm64 libgomp1 arm64 14.2.0-8ubuntu1 [145 kB] 550s Get:19 http://ftpmaster.internal/ubuntu plucky/main arm64 libitm1 arm64 14.2.0-8ubuntu1 [27.8 kB] 550s Get:20 http://ftpmaster.internal/ubuntu plucky/main arm64 libasan8 arm64 14.2.0-8ubuntu1 [2893 kB] 550s Get:21 http://ftpmaster.internal/ubuntu plucky/main arm64 liblsan0 arm64 14.2.0-8ubuntu1 [1283 kB] 550s Get:22 http://ftpmaster.internal/ubuntu plucky/main arm64 libtsan2 arm64 14.2.0-8ubuntu1 [2686 kB] 550s Get:23 http://ftpmaster.internal/ubuntu plucky/main arm64 libubsan1 arm64 14.2.0-8ubuntu1 [1151 kB] 550s Get:24 http://ftpmaster.internal/ubuntu plucky/main arm64 libhwasan0 arm64 14.2.0-8ubuntu1 [1598 kB] 550s Get:25 http://ftpmaster.internal/ubuntu plucky/main arm64 libgcc-14-dev arm64 14.2.0-8ubuntu1 [2594 kB] 550s Get:26 http://ftpmaster.internal/ubuntu plucky/main arm64 gcc-14-aarch64-linux-gnu arm64 14.2.0-8ubuntu1 [20.9 MB] 550s Get:27 http://ftpmaster.internal/ubuntu plucky/main arm64 gcc-14 arm64 14.2.0-8ubuntu1 [518 kB] 550s Get:28 http://ftpmaster.internal/ubuntu plucky/main arm64 gcc-aarch64-linux-gnu arm64 4:14.1.0-2ubuntu1 [1200 B] 550s Get:29 http://ftpmaster.internal/ubuntu plucky/main arm64 gcc arm64 4:14.1.0-2ubuntu1 [4994 B] 550s Get:30 http://ftpmaster.internal/ubuntu plucky/main arm64 libstdc++-14-dev arm64 14.2.0-8ubuntu1 [2476 kB] 550s Get:31 http://ftpmaster.internal/ubuntu plucky/main arm64 g++-14-aarch64-linux-gnu arm64 14.2.0-8ubuntu1 [12.1 MB] 551s Get:32 http://ftpmaster.internal/ubuntu plucky/main arm64 g++-14 arm64 14.2.0-8ubuntu1 [19.9 kB] 551s Get:33 http://ftpmaster.internal/ubuntu plucky/main arm64 g++-aarch64-linux-gnu arm64 4:14.1.0-2ubuntu1 [958 B] 551s Get:34 http://ftpmaster.internal/ubuntu plucky/main arm64 g++ arm64 4:14.1.0-2ubuntu1 [1080 B] 551s Get:35 http://ftpmaster.internal/ubuntu plucky/main arm64 build-essential arm64 12.10ubuntu1 [4932 B] 551s Get:36 http://ftpmaster.internal/ubuntu plucky/main arm64 libdebhelper-perl all 13.20ubuntu1 [94.2 kB] 551s Get:37 http://ftpmaster.internal/ubuntu plucky/main arm64 libtool all 2.4.7-8 [166 kB] 551s Get:38 http://ftpmaster.internal/ubuntu plucky/main arm64 dh-autoreconf all 20 [16.1 kB] 551s Get:39 http://ftpmaster.internal/ubuntu plucky/main arm64 libarchive-zip-perl all 1.68-1 [90.2 kB] 551s Get:40 http://ftpmaster.internal/ubuntu plucky/main arm64 libfile-stripnondeterminism-perl all 1.14.0-1 [20.1 kB] 551s Get:41 http://ftpmaster.internal/ubuntu plucky/main arm64 dh-strip-nondeterminism all 1.14.0-1 [5058 B] 551s Get:42 http://ftpmaster.internal/ubuntu plucky/main arm64 debugedit arm64 1:5.1-1 [45.9 kB] 551s Get:43 http://ftpmaster.internal/ubuntu plucky/main arm64 dwz arm64 0.15-1build6 [113 kB] 551s Get:44 http://ftpmaster.internal/ubuntu plucky/main arm64 gettext arm64 0.22.5-2 [930 kB] 551s Get:45 http://ftpmaster.internal/ubuntu plucky/main arm64 intltool-debian all 0.35.0+20060710.6 [23.2 kB] 551s Get:46 http://ftpmaster.internal/ubuntu plucky/main arm64 po-debconf all 1.0.21+nmu1 [233 kB] 551s Get:47 http://ftpmaster.internal/ubuntu plucky/main arm64 debhelper all 13.20ubuntu1 [893 kB] 551s Get:48 http://ftpmaster.internal/ubuntu plucky/universe arm64 dh-python all 6.20241024 [112 kB] 551s Get:49 http://ftpmaster.internal/ubuntu plucky/main arm64 xml-core all 0.19 [20.3 kB] 551s Get:50 http://ftpmaster.internal/ubuntu plucky/main arm64 docutils-common all 0.21.2+dfsg-2 [131 kB] 551s Get:51 http://ftpmaster.internal/ubuntu plucky/main arm64 fonts-font-awesome all 5.0.10+really4.7.0~dfsg-4.1 [516 kB] 551s Get:52 http://ftpmaster.internal/ubuntu plucky/universe arm64 fonts-glyphicons-halflings all 1.009~3.4.1+dfsg-3 [118 kB] 551s Get:53 http://ftpmaster.internal/ubuntu plucky/main arm64 fonts-mathjax all 2.7.9+dfsg-1 [2208 kB] 551s Get:54 http://ftpmaster.internal/ubuntu plucky/main arm64 libargon2-1 arm64 0~20190702+dfsg-4build1 [20.5 kB] 551s Get:55 http://ftpmaster.internal/ubuntu plucky/main arm64 libblas3 arm64 3.12.0-4 [152 kB] 551s Get:56 http://ftpmaster.internal/ubuntu plucky/main arm64 libcares2 arm64 1.34.2-1 [95.2 kB] 551s Get:57 http://ftpmaster.internal/ubuntu plucky/main arm64 libgfortran5 arm64 14.2.0-8ubuntu1 [438 kB] 551s Get:58 http://ftpmaster.internal/ubuntu plucky/universe arm64 libjs-bootstrap all 3.4.1+dfsg-3 [129 kB] 551s Get:59 http://ftpmaster.internal/ubuntu plucky/main arm64 libjs-jquery all 3.6.1+dfsg+~3.5.14-1 [328 kB] 551s Get:60 http://ftpmaster.internal/ubuntu plucky/universe arm64 libjs-sortable-tablesort all 3.1.0+ds-2 [12.6 kB] 551s Get:61 http://ftpmaster.internal/ubuntu plucky/main arm64 libjs-underscore all 1.13.4~dfsg+~1.11.4-3 [118 kB] 551s Get:62 http://ftpmaster.internal/ubuntu plucky/main arm64 libjs-sphinxdoc all 7.4.7-4 [158 kB] 551s Get:63 http://ftpmaster.internal/ubuntu plucky/universe arm64 libjs-sprintf-js all 1.1.2+ds1+~1.1.2-1 [12.8 kB] 551s Get:64 http://ftpmaster.internal/ubuntu plucky/main arm64 libjson-perl all 4.10000-1 [81.9 kB] 551s Get:65 http://ftpmaster.internal/ubuntu plucky/main arm64 liblapack3 arm64 3.12.0-4 [2305 kB] 551s Get:66 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-xtend all 4.0.2-3 [3902 B] 551s Get:67 http://ftpmaster.internal/ubuntu plucky/universe arm64 nodejs arm64 20.18.0+dfsg-2 [336 kB] 551s Get:68 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-acorn all 8.8.1+ds+~cs25.17.7-2 [115 kB] 551s Get:69 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-cjs-module-lexer all 1.2.3+dfsg-1 [32.1 kB] 551s Get:70 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-balanced-match all 2.0.0-1 [4910 B] 551s Get:71 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-brace-expansion all 2.0.1+~1.1.0-1 [8072 B] 551s Get:72 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-minimatch all 9.0.3-5 [78.2 kB] 551s Get:73 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-undici all 5.28.4+dfsg1+~cs23.12.11-2 [321 kB] 551s Get:74 http://ftpmaster.internal/ubuntu plucky/universe arm64 libnode115 arm64 20.18.0+dfsg-2 [12.8 MB] 552s Get:75 http://ftpmaster.internal/ubuntu plucky/universe arm64 libnorm1t64 arm64 1.5.9+dfsg-3.1build1 [150 kB] 552s Get:76 http://ftpmaster.internal/ubuntu plucky/universe arm64 libpgm-5.3-0t64 arm64 5.3.128~dfsg-2.1build1 [162 kB] 552s Get:77 http://ftpmaster.internal/ubuntu plucky/main arm64 libpython3.13-stdlib arm64 3.13.0-2 [2073 kB] 552s Get:78 http://ftpmaster.internal/ubuntu plucky/main arm64 libsodium23 arm64 1.0.18-1build3 [119 kB] 552s Get:79 http://ftpmaster.internal/ubuntu plucky/universe arm64 libzmq5 arm64 4.3.5-1build2 [247 kB] 552s Get:80 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-esprima all 4.0.1+ds+~4.0.3-2 [69.3 kB] 552s Get:81 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-sprintf-js all 1.1.2+ds1+~1.1.2-1 [3916 B] 552s Get:82 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-argparse all 2.0.1-2 [33.2 kB] 552s Get:83 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-js-yaml all 4.1.0+dfsg+~4.0.5-7 [61.9 kB] 552s Get:84 http://ftpmaster.internal/ubuntu plucky/universe arm64 node-uglify-js all 3.17.4-2 [205 kB] 552s Get:85 http://ftpmaster.internal/ubuntu plucky/universe arm64 pybuild-plugin-autopkgtest all 6.20241024 [1746 B] 552s Get:86 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-packaging all 24.2-1 [51.5 kB] 552s Get:87 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pyproject-hooks all 1.2.0-1 [10.2 kB] 552s Get:88 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-toml all 0.10.2-1 [16.5 kB] 552s Get:89 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-wheel all 0.45.0-1 [57.7 kB] 552s Get:90 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-build all 1.2.2-1 [31.0 kB] 552s Get:91 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-installer all 0.7.0+dfsg1-3 [17.4 kB] 552s Get:92 http://ftpmaster.internal/ubuntu plucky/universe arm64 pybuild-plugin-pyproject all 6.20241024 [1728 B] 552s Get:93 http://ftpmaster.internal/ubuntu plucky/main arm64 libjs-mathjax all 2.7.9+dfsg-1 [5665 kB] 552s Get:94 http://ftpmaster.internal/ubuntu plucky/universe arm64 python-dask-doc all 2024.5.2+dfsg-1 [10.8 MB] 552s Get:95 http://ftpmaster.internal/ubuntu plucky/main arm64 sphinx-rtd-theme-common all 3.0.2+dfsg-1 [1014 kB] 552s Get:96 http://ftpmaster.internal/ubuntu plucky/universe arm64 python-fsspec-doc all 2024.9.0-1 [313 kB] 552s Get:97 http://ftpmaster.internal/ubuntu plucky/main arm64 python-numpy-doc all 1:1.26.4+ds-11ubuntu1 [5481 kB] 553s Get:98 http://ftpmaster.internal/ubuntu plucky/universe arm64 python-pandas-doc all 2.2.3+dfsg-5ubuntu1 [9117 kB] 553s Get:99 http://ftpmaster.internal/ubuntu plucky/main arm64 python3.12-doc all 3.12.7-3 [12.4 MB] 553s Get:100 http://ftpmaster.internal/ubuntu plucky-proposed/main arm64 python3-doc all 3.12.7-1 [10.3 kB] 553s Get:101 http://ftpmaster.internal/ubuntu plucky/universe arm64 sass-stylesheets-bulma all 0.9.4~ds-1 [113 kB] 553s Get:102 http://ftpmaster.internal/ubuntu plucky/universe arm64 python-distributed-doc all 2024.5.2+ds.1-8 [3143 kB] 554s Get:103 http://ftpmaster.internal/ubuntu plucky/universe arm64 python-tinycss2-common all 1.4.0-1 [47.0 kB] 554s Get:104 http://ftpmaster.internal/ubuntu plucky/main arm64 python3.13 arm64 3.13.0-2 [719 kB] 554s Get:105 http://ftpmaster.internal/ubuntu plucky-proposed/main arm64 python3-all arm64 3.12.7-1 [890 B] 554s Get:106 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-sniffio all 1.3.1-1 [7262 B] 554s Get:107 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-anyio all 4.6.2-4 [60.0 kB] 554s Get:108 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-argon2 arm64 21.1.0-2build1 [21.4 kB] 554s Get:109 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-dateutil all 2.9.0-3 [80.2 kB] 554s Get:110 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-arrow all 1.3.0-1.1ubuntu1 [56.1 kB] 554s Get:111 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-async-generator all 1.10-4 [17.5 kB] 554s Get:112 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-webencodings all 0.5.1-5 [11.5 kB] 554s Get:113 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-html5lib all 1.2-1 [90.8 kB] 554s Get:114 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-bleach all 6.2.0-1 [43.9 kB] 554s Get:115 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-soupsieve all 2.6-1 [33.0 kB] 554s Get:116 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-bs4 all 4.12.3-3 [109 kB] 554s Get:117 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-colorama all 0.4.6-4 [32.1 kB] 554s Get:118 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-click all 8.1.7-2 [79.5 kB] 554s Get:119 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-cloudpickle all 3.0.0-2 [21.5 kB] 554s Get:120 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-fsspec all 2024.9.0-1 [207 kB] 554s Get:121 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-toolz all 1.0.0-1 [44.9 kB] 554s Get:122 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-locket all 1.0.0-2 [5872 B] 554s Get:123 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-partd all 1.4.2-1 [15.7 kB] 554s Get:124 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-dask all 2024.5.2+dfsg-1 [849 kB] 554s Get:125 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-roman all 4.2-1 [10.0 kB] 554s Get:126 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-docutils all 0.21.2+dfsg-2 [409 kB] 554s Get:127 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-defusedxml all 0.7.1-2 [42.0 kB] 554s Get:128 http://ftpmaster.internal/ubuntu plucky/main arm64 sphinx-common all 7.4.7-4 [775 kB] 554s Get:129 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-alabaster all 0.7.16-0.1 [18.5 kB] 554s Get:130 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-imagesize all 1.4.1-1 [6844 B] 554s Get:131 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-snowballstemmer all 2.2.0-4build1 [59.8 kB] 554s Get:132 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-sphinx all 7.4.7-4 [593 kB] 554s Get:133 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pydata-sphinx-theme all 0.15.4+dfsg-2 [41.5 kB] 554s Get:134 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-sphinx-book-theme all 0.1.7-3 [42.8 kB] 554s Get:135 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-dask-sphinx-theme all 3.0.5-2 [15.9 kB] 554s Get:136 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-decorator all 5.1.1-5 [10.1 kB] 554s Get:137 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-msgpack arm64 1.0.3-3build3 [106 kB] 554s Get:138 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-psutil arm64 5.9.8-2build3 [196 kB] 554s Get:139 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-sortedcontainers all 2.4.0-2 [27.6 kB] 554s Get:140 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-tblib all 3.0.0-5 [12.9 kB] 554s Get:141 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-tornado arm64 6.4.1-3 [299 kB] 554s Get:142 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-zict all 3.0.0-2ubuntu1 [30.4 kB] 554s Get:143 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-distributed all 2024.5.2+ds.1-8 [1006 kB] 554s Get:144 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-fastjsonschema all 2.20.0-1 [20.1 kB] 554s Get:145 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-fqdn all 1.5.1-2 [7688 B] 554s Get:146 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-iniconfig all 1.1.1-2 [6024 B] 554s Get:147 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-isoduration all 20.11.0+git20211126.ae0bd61-2 [12.5 kB] 554s Get:148 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-platformdirs all 4.3.6-1 [16.8 kB] 554s Get:149 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-traitlets all 5.14.3+really5.14.3-1 [71.5 kB] 554s Get:150 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-jupyter-core all 5.7.2-4 [28.0 kB] 554s Get:151 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-py all 1.11.0-2 [72.7 kB] 554s Get:152 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-zmq arm64 24.0.1-5build2 [347 kB] 554s Get:153 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-jupyter-client all 8.6.3-1 [78.2 kB] 555s Get:154 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pythonjsonlogger all 3.1.0-1 [11.8 kB] 555s Get:155 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-rfc3339-validator all 0.1.4-2 [3930 B] 555s Get:156 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-rfc3986-validator all 0.1.1-2 [4758 B] 555s Get:157 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-uritemplate all 4.1.1-3 [9762 B] 555s Get:158 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-webcolors all 1.13-1 [13.6 kB] 555s Get:159 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-jupyter-events all 0.10.0-3 [15.5 kB] 555s Get:160 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-ptyprocess all 0.7.0-6 [14.8 kB] 555s Get:161 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-terminado all 0.18.1-1 [13.2 kB] 555s Get:162 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-jupyter-server-terminals all 0.5.3-2 [10.9 kB] 555s Get:163 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-jupyterlab-pygments all 0.2.2-3 [6054 B] 555s Get:164 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-mistune all 3.0.2-2 [32.9 kB] 555s Get:165 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-nbformat all 5.9.1-1 [41.2 kB] 555s Get:166 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-nbclient all 0.8.0-1 [55.6 kB] 555s Get:167 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pandocfilters all 1.5.1-1 [23.6 kB] 555s Get:168 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-tinycss2 all 1.4.0-1 [22.5 kB] 555s Get:169 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-nbconvert all 7.16.4-2 [139 kB] 555s Get:170 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-overrides all 7.7.0-2 [14.4 kB] 555s Get:171 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-prometheus-client all 0.19.0+ds1-1 [41.7 kB] 555s Get:172 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-send2trash all 1.8.3-1 [14.6 kB] 555s Get:173 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-websocket all 1.8.0-2 [38.5 kB] 555s Get:174 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-jupyter-server all 2.14.2-4 [183 kB] 555s Get:175 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-numpy arm64 1:1.26.4+ds-11ubuntu1 [4149 kB] 555s Get:176 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-tabulate all 0.9.0-1 [45.3 kB] 555s Get:177 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-numpydoc all 1.6.0-2 [50.5 kB] 555s Get:178 http://ftpmaster.internal/ubuntu plucky/main arm64 python3-tz all 2024.1-2 [31.4 kB] 555s Get:179 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pandas-lib arm64 2.2.3+dfsg-5ubuntu1 [6921 kB] 555s Get:180 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pandas all 2.2.3+dfsg-5ubuntu1 [3112 kB] 555s Get:181 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pluggy all 1.5.0-1 [21.0 kB] 555s Get:182 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pytest all 8.3.3-1 [251 kB] 555s Get:183 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pytest-asyncio all 0.20.3-1.3 [10.7 kB] 555s Get:184 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pytest-rerunfailures all 14.0-2 [13.7 kB] 555s Get:185 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-pytest-timeout all 2.3.1-1 [22.1 kB] 555s Get:186 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-sortedcollections all 2.1.0-2 [9720 B] 555s Get:187 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-sphinx-click all 5.1.0-1 [10.0 kB] 555s Get:188 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-sphinx-design all 0.6.1-1 [894 kB] 555s Get:189 http://ftpmaster.internal/ubuntu plucky/universe arm64 python3-versioneer all 0.29-1 [44.0 kB] 555s Get:190 http://ftpmaster.internal/ubuntu plucky/main arm64 tzdata-legacy all 2024b-1ubuntu2 [99.9 kB] 555s Get:191 http://ftpmaster.internal/ubuntu plucky/universe arm64 uglifyjs all 3.17.4-2 [10.1 kB] 556s Fetched 165 MB in 7s (24.0 MB/s) 556s Selecting previously unselected package fonts-lato. 556s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 80032 files and directories currently installed.) 556s Preparing to unpack .../000-fonts-lato_2.015-1_all.deb ... 556s Unpacking fonts-lato (2.015-1) ... 557s Selecting previously unselected package libpython3.13-minimal:arm64. 557s Preparing to unpack .../001-libpython3.13-minimal_3.13.0-2_arm64.deb ... 557s Unpacking libpython3.13-minimal:arm64 (3.13.0-2) ... 557s Selecting previously unselected package python3.13-minimal. 557s Preparing to unpack .../002-python3.13-minimal_3.13.0-2_arm64.deb ... 557s Unpacking python3.13-minimal (3.13.0-2) ... 557s Selecting previously unselected package sgml-base. 557s Preparing to unpack .../003-sgml-base_1.31_all.deb ... 557s Unpacking sgml-base (1.31) ... 557s Selecting previously unselected package m4. 557s Preparing to unpack .../004-m4_1.4.19-4build1_arm64.deb ... 557s Unpacking m4 (1.4.19-4build1) ... 557s Selecting previously unselected package autoconf. 557s Preparing to unpack .../005-autoconf_2.72-3_all.deb ... 557s Unpacking autoconf (2.72-3) ... 557s Selecting previously unselected package autotools-dev. 557s Preparing to unpack .../006-autotools-dev_20220109.1_all.deb ... 557s Unpacking autotools-dev (20220109.1) ... 557s Selecting previously unselected package automake. 557s Preparing to unpack .../007-automake_1%3a1.16.5-1.3ubuntu1_all.deb ... 557s Unpacking automake (1:1.16.5-1.3ubuntu1) ... 557s Selecting previously unselected package autopoint. 557s Preparing to unpack .../008-autopoint_0.22.5-2_all.deb ... 557s Unpacking autopoint (0.22.5-2) ... 557s Selecting previously unselected package libisl23:arm64. 557s Preparing to unpack .../009-libisl23_0.27-1_arm64.deb ... 557s Unpacking libisl23:arm64 (0.27-1) ... 557s Selecting previously unselected package libmpc3:arm64. 557s Preparing to unpack .../010-libmpc3_1.3.1-1build2_arm64.deb ... 557s Unpacking libmpc3:arm64 (1.3.1-1build2) ... 557s Selecting previously unselected package cpp-14-aarch64-linux-gnu. 557s Preparing to unpack .../011-cpp-14-aarch64-linux-gnu_14.2.0-8ubuntu1_arm64.deb ... 557s Unpacking cpp-14-aarch64-linux-gnu (14.2.0-8ubuntu1) ... 557s Selecting previously unselected package cpp-14. 557s Preparing to unpack .../012-cpp-14_14.2.0-8ubuntu1_arm64.deb ... 557s Unpacking cpp-14 (14.2.0-8ubuntu1) ... 557s Selecting previously unselected package cpp-aarch64-linux-gnu. 557s Preparing to unpack .../013-cpp-aarch64-linux-gnu_4%3a14.1.0-2ubuntu1_arm64.deb ... 557s Unpacking cpp-aarch64-linux-gnu (4:14.1.0-2ubuntu1) ... 557s Selecting previously unselected package cpp. 557s Preparing to unpack .../014-cpp_4%3a14.1.0-2ubuntu1_arm64.deb ... 557s Unpacking cpp (4:14.1.0-2ubuntu1) ... 558s Selecting previously unselected package libcc1-0:arm64. 558s Preparing to unpack .../015-libcc1-0_14.2.0-8ubuntu1_arm64.deb ... 558s Unpacking libcc1-0:arm64 (14.2.0-8ubuntu1) ... 558s Selecting previously unselected package libgomp1:arm64. 558s Preparing to unpack .../016-libgomp1_14.2.0-8ubuntu1_arm64.deb ... 558s Unpacking libgomp1:arm64 (14.2.0-8ubuntu1) ... 558s Selecting previously unselected package libitm1:arm64. 558s Preparing to unpack .../017-libitm1_14.2.0-8ubuntu1_arm64.deb ... 558s Unpacking libitm1:arm64 (14.2.0-8ubuntu1) ... 558s Selecting previously unselected package libasan8:arm64. 558s Preparing to unpack .../018-libasan8_14.2.0-8ubuntu1_arm64.deb ... 558s Unpacking libasan8:arm64 (14.2.0-8ubuntu1) ... 558s Selecting previously unselected package liblsan0:arm64. 558s Preparing to unpack .../019-liblsan0_14.2.0-8ubuntu1_arm64.deb ... 558s Unpacking liblsan0:arm64 (14.2.0-8ubuntu1) ... 558s Selecting previously unselected package libtsan2:arm64. 558s Preparing to unpack .../020-libtsan2_14.2.0-8ubuntu1_arm64.deb ... 558s Unpacking libtsan2:arm64 (14.2.0-8ubuntu1) ... 558s Selecting previously unselected package libubsan1:arm64. 558s Preparing to unpack .../021-libubsan1_14.2.0-8ubuntu1_arm64.deb ... 558s Unpacking libubsan1:arm64 (14.2.0-8ubuntu1) ... 558s Selecting previously unselected package libhwasan0:arm64. 558s Preparing to unpack .../022-libhwasan0_14.2.0-8ubuntu1_arm64.deb ... 558s Unpacking libhwasan0:arm64 (14.2.0-8ubuntu1) ... 558s Selecting previously unselected package libgcc-14-dev:arm64. 558s Preparing to unpack .../023-libgcc-14-dev_14.2.0-8ubuntu1_arm64.deb ... 558s Unpacking libgcc-14-dev:arm64 (14.2.0-8ubuntu1) ... 558s Selecting previously unselected package gcc-14-aarch64-linux-gnu. 558s Preparing to unpack .../024-gcc-14-aarch64-linux-gnu_14.2.0-8ubuntu1_arm64.deb ... 558s Unpacking gcc-14-aarch64-linux-gnu (14.2.0-8ubuntu1) ... 559s Selecting previously unselected package gcc-14. 559s Preparing to unpack .../025-gcc-14_14.2.0-8ubuntu1_arm64.deb ... 559s Unpacking gcc-14 (14.2.0-8ubuntu1) ... 559s Selecting previously unselected package gcc-aarch64-linux-gnu. 559s Preparing to unpack .../026-gcc-aarch64-linux-gnu_4%3a14.1.0-2ubuntu1_arm64.deb ... 559s Unpacking gcc-aarch64-linux-gnu (4:14.1.0-2ubuntu1) ... 559s Selecting previously unselected package gcc. 559s Preparing to unpack .../027-gcc_4%3a14.1.0-2ubuntu1_arm64.deb ... 559s Unpacking gcc (4:14.1.0-2ubuntu1) ... 559s Selecting previously unselected package libstdc++-14-dev:arm64. 559s Preparing to unpack .../028-libstdc++-14-dev_14.2.0-8ubuntu1_arm64.deb ... 559s Unpacking libstdc++-14-dev:arm64 (14.2.0-8ubuntu1) ... 559s Selecting previously unselected package g++-14-aarch64-linux-gnu. 559s Preparing to unpack .../029-g++-14-aarch64-linux-gnu_14.2.0-8ubuntu1_arm64.deb ... 559s Unpacking g++-14-aarch64-linux-gnu (14.2.0-8ubuntu1) ... 560s Selecting previously unselected package g++-14. 560s Preparing to unpack .../030-g++-14_14.2.0-8ubuntu1_arm64.deb ... 560s Unpacking g++-14 (14.2.0-8ubuntu1) ... 560s Selecting previously unselected package g++-aarch64-linux-gnu. 560s Preparing to unpack .../031-g++-aarch64-linux-gnu_4%3a14.1.0-2ubuntu1_arm64.deb ... 560s Unpacking g++-aarch64-linux-gnu (4:14.1.0-2ubuntu1) ... 560s Selecting previously unselected package g++. 560s Preparing to unpack .../032-g++_4%3a14.1.0-2ubuntu1_arm64.deb ... 560s Unpacking g++ (4:14.1.0-2ubuntu1) ... 560s Selecting previously unselected package build-essential. 560s Preparing to unpack .../033-build-essential_12.10ubuntu1_arm64.deb ... 560s Unpacking build-essential (12.10ubuntu1) ... 560s Selecting previously unselected package libdebhelper-perl. 560s Preparing to unpack .../034-libdebhelper-perl_13.20ubuntu1_all.deb ... 560s Unpacking libdebhelper-perl (13.20ubuntu1) ... 560s Selecting previously unselected package libtool. 560s Preparing to unpack .../035-libtool_2.4.7-8_all.deb ... 560s Unpacking libtool (2.4.7-8) ... 560s Selecting previously unselected package dh-autoreconf. 560s Preparing to unpack .../036-dh-autoreconf_20_all.deb ... 560s Unpacking dh-autoreconf (20) ... 560s Selecting previously unselected package libarchive-zip-perl. 560s Preparing to unpack .../037-libarchive-zip-perl_1.68-1_all.deb ... 560s Unpacking libarchive-zip-perl (1.68-1) ... 560s Selecting previously unselected package libfile-stripnondeterminism-perl. 560s Preparing to unpack .../038-libfile-stripnondeterminism-perl_1.14.0-1_all.deb ... 560s Unpacking libfile-stripnondeterminism-perl (1.14.0-1) ... 560s Selecting previously unselected package dh-strip-nondeterminism. 560s Preparing to unpack .../039-dh-strip-nondeterminism_1.14.0-1_all.deb ... 560s Unpacking dh-strip-nondeterminism (1.14.0-1) ... 560s Selecting previously unselected package debugedit. 560s Preparing to unpack .../040-debugedit_1%3a5.1-1_arm64.deb ... 560s Unpacking debugedit (1:5.1-1) ... 560s Selecting previously unselected package dwz. 560s Preparing to unpack .../041-dwz_0.15-1build6_arm64.deb ... 560s Unpacking dwz (0.15-1build6) ... 560s Selecting previously unselected package gettext. 560s Preparing to unpack .../042-gettext_0.22.5-2_arm64.deb ... 560s Unpacking gettext (0.22.5-2) ... 560s Selecting previously unselected package intltool-debian. 560s Preparing to unpack .../043-intltool-debian_0.35.0+20060710.6_all.deb ... 560s Unpacking intltool-debian (0.35.0+20060710.6) ... 560s Selecting previously unselected package po-debconf. 560s Preparing to unpack .../044-po-debconf_1.0.21+nmu1_all.deb ... 560s Unpacking po-debconf (1.0.21+nmu1) ... 560s Selecting previously unselected package debhelper. 560s Preparing to unpack .../045-debhelper_13.20ubuntu1_all.deb ... 560s Unpacking debhelper (13.20ubuntu1) ... 560s Selecting previously unselected package dh-python. 560s Preparing to unpack .../046-dh-python_6.20241024_all.deb ... 560s Unpacking dh-python (6.20241024) ... 560s Selecting previously unselected package xml-core. 560s Preparing to unpack .../047-xml-core_0.19_all.deb ... 560s Unpacking xml-core (0.19) ... 560s Selecting previously unselected package docutils-common. 560s Preparing to unpack .../048-docutils-common_0.21.2+dfsg-2_all.deb ... 560s Unpacking docutils-common (0.21.2+dfsg-2) ... 560s Selecting previously unselected package fonts-font-awesome. 560s Preparing to unpack .../049-fonts-font-awesome_5.0.10+really4.7.0~dfsg-4.1_all.deb ... 560s Unpacking fonts-font-awesome (5.0.10+really4.7.0~dfsg-4.1) ... 561s Selecting previously unselected package fonts-glyphicons-halflings. 561s Preparing to unpack .../050-fonts-glyphicons-halflings_1.009~3.4.1+dfsg-3_all.deb ... 561s Unpacking fonts-glyphicons-halflings (1.009~3.4.1+dfsg-3) ... 561s Selecting previously unselected package fonts-mathjax. 561s Preparing to unpack .../051-fonts-mathjax_2.7.9+dfsg-1_all.deb ... 561s Unpacking fonts-mathjax (2.7.9+dfsg-1) ... 561s Selecting previously unselected package libargon2-1:arm64. 561s Preparing to unpack .../052-libargon2-1_0~20190702+dfsg-4build1_arm64.deb ... 561s Unpacking libargon2-1:arm64 (0~20190702+dfsg-4build1) ... 561s Selecting previously unselected package libblas3:arm64. 561s Preparing to unpack .../053-libblas3_3.12.0-4_arm64.deb ... 561s Unpacking libblas3:arm64 (3.12.0-4) ... 561s Selecting previously unselected package libcares2:arm64. 561s Preparing to unpack .../054-libcares2_1.34.2-1_arm64.deb ... 561s Unpacking libcares2:arm64 (1.34.2-1) ... 561s Selecting previously unselected package libgfortran5:arm64. 561s Preparing to unpack .../055-libgfortran5_14.2.0-8ubuntu1_arm64.deb ... 561s Unpacking libgfortran5:arm64 (14.2.0-8ubuntu1) ... 561s Selecting previously unselected package libjs-bootstrap. 561s Preparing to unpack .../056-libjs-bootstrap_3.4.1+dfsg-3_all.deb ... 561s Unpacking libjs-bootstrap (3.4.1+dfsg-3) ... 561s Selecting previously unselected package libjs-jquery. 561s Preparing to unpack .../057-libjs-jquery_3.6.1+dfsg+~3.5.14-1_all.deb ... 561s Unpacking libjs-jquery (3.6.1+dfsg+~3.5.14-1) ... 561s Selecting previously unselected package libjs-sortable-tablesort. 561s Preparing to unpack .../058-libjs-sortable-tablesort_3.1.0+ds-2_all.deb ... 561s Unpacking libjs-sortable-tablesort (3.1.0+ds-2) ... 561s Selecting previously unselected package libjs-underscore. 561s Preparing to unpack .../059-libjs-underscore_1.13.4~dfsg+~1.11.4-3_all.deb ... 561s Unpacking libjs-underscore (1.13.4~dfsg+~1.11.4-3) ... 561s Selecting previously unselected package libjs-sphinxdoc. 561s Preparing to unpack .../060-libjs-sphinxdoc_7.4.7-4_all.deb ... 561s Unpacking libjs-sphinxdoc (7.4.7-4) ... 561s Selecting previously unselected package libjs-sprintf-js. 561s Preparing to unpack .../061-libjs-sprintf-js_1.1.2+ds1+~1.1.2-1_all.deb ... 561s Unpacking libjs-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 561s Selecting previously unselected package libjson-perl. 561s Preparing to unpack .../062-libjson-perl_4.10000-1_all.deb ... 561s Unpacking libjson-perl (4.10000-1) ... 561s Selecting previously unselected package liblapack3:arm64. 561s Preparing to unpack .../063-liblapack3_3.12.0-4_arm64.deb ... 561s Unpacking liblapack3:arm64 (3.12.0-4) ... 561s Selecting previously unselected package node-xtend. 561s Preparing to unpack .../064-node-xtend_4.0.2-3_all.deb ... 561s Unpacking node-xtend (4.0.2-3) ... 562s Selecting previously unselected package nodejs. 562s Preparing to unpack .../065-nodejs_20.18.0+dfsg-2_arm64.deb ... 562s Unpacking nodejs (20.18.0+dfsg-2) ... 562s Selecting previously unselected package node-acorn. 562s Preparing to unpack .../066-node-acorn_8.8.1+ds+~cs25.17.7-2_all.deb ... 562s Unpacking node-acorn (8.8.1+ds+~cs25.17.7-2) ... 562s Selecting previously unselected package node-cjs-module-lexer. 562s Preparing to unpack .../067-node-cjs-module-lexer_1.2.3+dfsg-1_all.deb ... 562s Unpacking node-cjs-module-lexer (1.2.3+dfsg-1) ... 562s Selecting previously unselected package node-balanced-match. 562s Preparing to unpack .../068-node-balanced-match_2.0.0-1_all.deb ... 562s Unpacking node-balanced-match (2.0.0-1) ... 562s Selecting previously unselected package node-brace-expansion. 562s Preparing to unpack .../069-node-brace-expansion_2.0.1+~1.1.0-1_all.deb ... 562s Unpacking node-brace-expansion (2.0.1+~1.1.0-1) ... 562s Selecting previously unselected package node-minimatch. 562s Preparing to unpack .../070-node-minimatch_9.0.3-5_all.deb ... 562s Unpacking node-minimatch (9.0.3-5) ... 562s Selecting previously unselected package node-undici. 562s Preparing to unpack .../071-node-undici_5.28.4+dfsg1+~cs23.12.11-2_all.deb ... 562s Unpacking node-undici (5.28.4+dfsg1+~cs23.12.11-2) ... 562s Selecting previously unselected package libnode115:arm64. 562s Preparing to unpack .../072-libnode115_20.18.0+dfsg-2_arm64.deb ... 562s Unpacking libnode115:arm64 (20.18.0+dfsg-2) ... 562s Selecting previously unselected package libnorm1t64:arm64. 562s Preparing to unpack .../073-libnorm1t64_1.5.9+dfsg-3.1build1_arm64.deb ... 562s Unpacking libnorm1t64:arm64 (1.5.9+dfsg-3.1build1) ... 562s Selecting previously unselected package libpgm-5.3-0t64:arm64. 562s Preparing to unpack .../074-libpgm-5.3-0t64_5.3.128~dfsg-2.1build1_arm64.deb ... 562s Unpacking libpgm-5.3-0t64:arm64 (5.3.128~dfsg-2.1build1) ... 562s Selecting previously unselected package libpython3.13-stdlib:arm64. 562s Preparing to unpack .../075-libpython3.13-stdlib_3.13.0-2_arm64.deb ... 562s Unpacking libpython3.13-stdlib:arm64 (3.13.0-2) ... 563s Selecting previously unselected package libsodium23:arm64. 563s Preparing to unpack .../076-libsodium23_1.0.18-1build3_arm64.deb ... 563s Unpacking libsodium23:arm64 (1.0.18-1build3) ... 563s Selecting previously unselected package libzmq5:arm64. 563s Preparing to unpack .../077-libzmq5_4.3.5-1build2_arm64.deb ... 563s Unpacking libzmq5:arm64 (4.3.5-1build2) ... 563s Selecting previously unselected package node-esprima. 563s Preparing to unpack .../078-node-esprima_4.0.1+ds+~4.0.3-2_all.deb ... 563s Unpacking node-esprima (4.0.1+ds+~4.0.3-2) ... 563s Selecting previously unselected package node-sprintf-js. 563s Preparing to unpack .../079-node-sprintf-js_1.1.2+ds1+~1.1.2-1_all.deb ... 563s Unpacking node-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 563s Selecting previously unselected package node-argparse. 563s Preparing to unpack .../080-node-argparse_2.0.1-2_all.deb ... 563s Unpacking node-argparse (2.0.1-2) ... 563s Selecting previously unselected package node-js-yaml. 563s Preparing to unpack .../081-node-js-yaml_4.1.0+dfsg+~4.0.5-7_all.deb ... 563s Unpacking node-js-yaml (4.1.0+dfsg+~4.0.5-7) ... 563s Selecting previously unselected package node-uglify-js. 563s Preparing to unpack .../082-node-uglify-js_3.17.4-2_all.deb ... 563s Unpacking node-uglify-js (3.17.4-2) ... 563s Selecting previously unselected package pybuild-plugin-autopkgtest. 563s Preparing to unpack .../083-pybuild-plugin-autopkgtest_6.20241024_all.deb ... 563s Unpacking pybuild-plugin-autopkgtest (6.20241024) ... 563s Selecting previously unselected package python3-packaging. 563s Preparing to unpack .../084-python3-packaging_24.2-1_all.deb ... 563s Unpacking python3-packaging (24.2-1) ... 563s Selecting previously unselected package python3-pyproject-hooks. 563s Preparing to unpack .../085-python3-pyproject-hooks_1.2.0-1_all.deb ... 563s Unpacking python3-pyproject-hooks (1.2.0-1) ... 563s Selecting previously unselected package python3-toml. 563s Preparing to unpack .../086-python3-toml_0.10.2-1_all.deb ... 563s Unpacking python3-toml (0.10.2-1) ... 563s Selecting previously unselected package python3-wheel. 563s Preparing to unpack .../087-python3-wheel_0.45.0-1_all.deb ... 563s Unpacking python3-wheel (0.45.0-1) ... 563s Selecting previously unselected package python3-build. 563s Preparing to unpack .../088-python3-build_1.2.2-1_all.deb ... 563s Unpacking python3-build (1.2.2-1) ... 563s Selecting previously unselected package python3-installer. 563s Preparing to unpack .../089-python3-installer_0.7.0+dfsg1-3_all.deb ... 563s Unpacking python3-installer (0.7.0+dfsg1-3) ... 563s Selecting previously unselected package pybuild-plugin-pyproject. 563s Preparing to unpack .../090-pybuild-plugin-pyproject_6.20241024_all.deb ... 563s Unpacking pybuild-plugin-pyproject (6.20241024) ... 563s Selecting previously unselected package libjs-mathjax. 563s Preparing to unpack .../091-libjs-mathjax_2.7.9+dfsg-1_all.deb ... 563s Unpacking libjs-mathjax (2.7.9+dfsg-1) ... 564s Selecting previously unselected package python-dask-doc. 564s Preparing to unpack .../092-python-dask-doc_2024.5.2+dfsg-1_all.deb ... 564s Unpacking python-dask-doc (2024.5.2+dfsg-1) ... 565s Selecting previously unselected package sphinx-rtd-theme-common. 565s Preparing to unpack .../093-sphinx-rtd-theme-common_3.0.2+dfsg-1_all.deb ... 565s Unpacking sphinx-rtd-theme-common (3.0.2+dfsg-1) ... 565s Selecting previously unselected package python-fsspec-doc. 565s Preparing to unpack .../094-python-fsspec-doc_2024.9.0-1_all.deb ... 565s Unpacking python-fsspec-doc (2024.9.0-1) ... 565s Selecting previously unselected package python-numpy-doc. 565s Preparing to unpack .../095-python-numpy-doc_1%3a1.26.4+ds-11ubuntu1_all.deb ... 565s Unpacking python-numpy-doc (1:1.26.4+ds-11ubuntu1) ... 565s Selecting previously unselected package python-pandas-doc. 565s Preparing to unpack .../096-python-pandas-doc_2.2.3+dfsg-5ubuntu1_all.deb ... 565s Unpacking python-pandas-doc (2.2.3+dfsg-5ubuntu1) ... 567s Selecting previously unselected package python3.12-doc. 567s Preparing to unpack .../097-python3.12-doc_3.12.7-3_all.deb ... 567s Unpacking python3.12-doc (3.12.7-3) ... 567s Selecting previously unselected package python3-doc. 567s Preparing to unpack .../098-python3-doc_3.12.7-1_all.deb ... 567s Unpacking python3-doc (3.12.7-1) ... 567s Selecting previously unselected package sass-stylesheets-bulma. 567s Preparing to unpack .../099-sass-stylesheets-bulma_0.9.4~ds-1_all.deb ... 567s Unpacking sass-stylesheets-bulma (0.9.4~ds-1) ... 567s Selecting previously unselected package python-distributed-doc. 567s Preparing to unpack .../100-python-distributed-doc_2024.5.2+ds.1-8_all.deb ... 567s Unpacking python-distributed-doc (2024.5.2+ds.1-8) ... 567s Selecting previously unselected package python-tinycss2-common. 567s Preparing to unpack .../101-python-tinycss2-common_1.4.0-1_all.deb ... 567s Unpacking python-tinycss2-common (1.4.0-1) ... 568s Selecting previously unselected package python3.13. 568s Preparing to unpack .../102-python3.13_3.13.0-2_arm64.deb ... 568s Unpacking python3.13 (3.13.0-2) ... 568s Selecting previously unselected package python3-all. 568s Preparing to unpack .../103-python3-all_3.12.7-1_arm64.deb ... 568s Unpacking python3-all (3.12.7-1) ... 568s Selecting previously unselected package python3-sniffio. 568s Preparing to unpack .../104-python3-sniffio_1.3.1-1_all.deb ... 568s Unpacking python3-sniffio (1.3.1-1) ... 568s Selecting previously unselected package python3-anyio. 568s Preparing to unpack .../105-python3-anyio_4.6.2-4_all.deb ... 568s Unpacking python3-anyio (4.6.2-4) ... 568s Selecting previously unselected package python3-argon2. 568s Preparing to unpack .../106-python3-argon2_21.1.0-2build1_arm64.deb ... 568s Unpacking python3-argon2 (21.1.0-2build1) ... 568s Selecting previously unselected package python3-dateutil. 568s Preparing to unpack .../107-python3-dateutil_2.9.0-3_all.deb ... 568s Unpacking python3-dateutil (2.9.0-3) ... 568s Selecting previously unselected package python3-arrow. 568s Preparing to unpack .../108-python3-arrow_1.3.0-1.1ubuntu1_all.deb ... 568s Unpacking python3-arrow (1.3.0-1.1ubuntu1) ... 568s Selecting previously unselected package python3-async-generator. 568s Preparing to unpack .../109-python3-async-generator_1.10-4_all.deb ... 568s Unpacking python3-async-generator (1.10-4) ... 568s Selecting previously unselected package python3-webencodings. 568s Preparing to unpack .../110-python3-webencodings_0.5.1-5_all.deb ... 568s Unpacking python3-webencodings (0.5.1-5) ... 568s Selecting previously unselected package python3-html5lib. 568s Preparing to unpack .../111-python3-html5lib_1.2-1_all.deb ... 568s Unpacking python3-html5lib (1.2-1) ... 568s Selecting previously unselected package python3-bleach. 568s Preparing to unpack .../112-python3-bleach_6.2.0-1_all.deb ... 568s Unpacking python3-bleach (6.2.0-1) ... 568s Selecting previously unselected package python3-soupsieve. 568s Preparing to unpack .../113-python3-soupsieve_2.6-1_all.deb ... 568s Unpacking python3-soupsieve (2.6-1) ... 568s Selecting previously unselected package python3-bs4. 568s Preparing to unpack .../114-python3-bs4_4.12.3-3_all.deb ... 568s Unpacking python3-bs4 (4.12.3-3) ... 568s Selecting previously unselected package python3-colorama. 568s Preparing to unpack .../115-python3-colorama_0.4.6-4_all.deb ... 568s Unpacking python3-colorama (0.4.6-4) ... 568s Selecting previously unselected package python3-click. 568s Preparing to unpack .../116-python3-click_8.1.7-2_all.deb ... 568s Unpacking python3-click (8.1.7-2) ... 568s Selecting previously unselected package python3-cloudpickle. 568s Preparing to unpack .../117-python3-cloudpickle_3.0.0-2_all.deb ... 568s Unpacking python3-cloudpickle (3.0.0-2) ... 568s Selecting previously unselected package python3-fsspec. 568s Preparing to unpack .../118-python3-fsspec_2024.9.0-1_all.deb ... 568s Unpacking python3-fsspec (2024.9.0-1) ... 568s Selecting previously unselected package python3-toolz. 568s Preparing to unpack .../119-python3-toolz_1.0.0-1_all.deb ... 568s Unpacking python3-toolz (1.0.0-1) ... 568s Selecting previously unselected package python3-locket. 568s Preparing to unpack .../120-python3-locket_1.0.0-2_all.deb ... 568s Unpacking python3-locket (1.0.0-2) ... 568s Selecting previously unselected package python3-partd. 568s Preparing to unpack .../121-python3-partd_1.4.2-1_all.deb ... 568s Unpacking python3-partd (1.4.2-1) ... 568s Selecting previously unselected package python3-dask. 568s Preparing to unpack .../122-python3-dask_2024.5.2+dfsg-1_all.deb ... 568s Unpacking python3-dask (2024.5.2+dfsg-1) ... 569s Selecting previously unselected package python3-roman. 569s Preparing to unpack .../123-python3-roman_4.2-1_all.deb ... 569s Unpacking python3-roman (4.2-1) ... 569s Selecting previously unselected package python3-docutils. 569s Preparing to unpack .../124-python3-docutils_0.21.2+dfsg-2_all.deb ... 569s Unpacking python3-docutils (0.21.2+dfsg-2) ... 569s Selecting previously unselected package python3-defusedxml. 569s Preparing to unpack .../125-python3-defusedxml_0.7.1-2_all.deb ... 569s Unpacking python3-defusedxml (0.7.1-2) ... 569s Selecting previously unselected package sphinx-common. 569s Preparing to unpack .../126-sphinx-common_7.4.7-4_all.deb ... 569s Unpacking sphinx-common (7.4.7-4) ... 569s Selecting previously unselected package python3-alabaster. 569s Preparing to unpack .../127-python3-alabaster_0.7.16-0.1_all.deb ... 569s Unpacking python3-alabaster (0.7.16-0.1) ... 569s Selecting previously unselected package python3-imagesize. 569s Preparing to unpack .../128-python3-imagesize_1.4.1-1_all.deb ... 569s Unpacking python3-imagesize (1.4.1-1) ... 569s Selecting previously unselected package python3-snowballstemmer. 569s Preparing to unpack .../129-python3-snowballstemmer_2.2.0-4build1_all.deb ... 569s Unpacking python3-snowballstemmer (2.2.0-4build1) ... 569s Selecting previously unselected package python3-sphinx. 569s Preparing to unpack .../130-python3-sphinx_7.4.7-4_all.deb ... 569s Unpacking python3-sphinx (7.4.7-4) ... 569s Selecting previously unselected package python3-pydata-sphinx-theme. 569s Preparing to unpack .../131-python3-pydata-sphinx-theme_0.15.4+dfsg-2_all.deb ... 569s Unpacking python3-pydata-sphinx-theme (0.15.4+dfsg-2) ... 569s Selecting previously unselected package python3-sphinx-book-theme. 569s Preparing to unpack .../132-python3-sphinx-book-theme_0.1.7-3_all.deb ... 569s Unpacking python3-sphinx-book-theme (0.1.7-3) ... 569s Selecting previously unselected package python3-dask-sphinx-theme. 569s Preparing to unpack .../133-python3-dask-sphinx-theme_3.0.5-2_all.deb ... 569s Unpacking python3-dask-sphinx-theme (3.0.5-2) ... 569s Selecting previously unselected package python3-decorator. 569s Preparing to unpack .../134-python3-decorator_5.1.1-5_all.deb ... 569s Unpacking python3-decorator (5.1.1-5) ... 569s Selecting previously unselected package python3-msgpack. 569s Preparing to unpack .../135-python3-msgpack_1.0.3-3build3_arm64.deb ... 569s Unpacking python3-msgpack (1.0.3-3build3) ... 569s Selecting previously unselected package python3-psutil. 569s Preparing to unpack .../136-python3-psutil_5.9.8-2build3_arm64.deb ... 569s Unpacking python3-psutil (5.9.8-2build3) ... 569s Selecting previously unselected package python3-sortedcontainers. 569s Preparing to unpack .../137-python3-sortedcontainers_2.4.0-2_all.deb ... 569s Unpacking python3-sortedcontainers (2.4.0-2) ... 570s Selecting previously unselected package python3-tblib. 570s Preparing to unpack .../138-python3-tblib_3.0.0-5_all.deb ... 570s Unpacking python3-tblib (3.0.0-5) ... 570s Selecting previously unselected package python3-tornado. 570s Preparing to unpack .../139-python3-tornado_6.4.1-3_arm64.deb ... 570s Unpacking python3-tornado (6.4.1-3) ... 570s Selecting previously unselected package python3-zict. 570s Preparing to unpack .../140-python3-zict_3.0.0-2ubuntu1_all.deb ... 570s Unpacking python3-zict (3.0.0-2ubuntu1) ... 570s Selecting previously unselected package python3-distributed. 570s Preparing to unpack .../141-python3-distributed_2024.5.2+ds.1-8_all.deb ... 570s Unpacking python3-distributed (2024.5.2+ds.1-8) ... 570s Selecting previously unselected package python3-fastjsonschema. 570s Preparing to unpack .../142-python3-fastjsonschema_2.20.0-1_all.deb ... 570s Unpacking python3-fastjsonschema (2.20.0-1) ... 570s Selecting previously unselected package python3-fqdn. 570s Preparing to unpack .../143-python3-fqdn_1.5.1-2_all.deb ... 570s Unpacking python3-fqdn (1.5.1-2) ... 570s Selecting previously unselected package python3-iniconfig. 570s Preparing to unpack .../144-python3-iniconfig_1.1.1-2_all.deb ... 570s Unpacking python3-iniconfig (1.1.1-2) ... 570s Selecting previously unselected package python3-isoduration. 570s Preparing to unpack .../145-python3-isoduration_20.11.0+git20211126.ae0bd61-2_all.deb ... 570s Unpacking python3-isoduration (20.11.0+git20211126.ae0bd61-2) ... 570s Selecting previously unselected package python3-platformdirs. 570s Preparing to unpack .../146-python3-platformdirs_4.3.6-1_all.deb ... 570s Unpacking python3-platformdirs (4.3.6-1) ... 570s Selecting previously unselected package python3-traitlets. 570s Preparing to unpack .../147-python3-traitlets_5.14.3+really5.14.3-1_all.deb ... 570s Unpacking python3-traitlets (5.14.3+really5.14.3-1) ... 570s Selecting previously unselected package python3-jupyter-core. 570s Preparing to unpack .../148-python3-jupyter-core_5.7.2-4_all.deb ... 570s Unpacking python3-jupyter-core (5.7.2-4) ... 570s Selecting previously unselected package python3-py. 570s Preparing to unpack .../149-python3-py_1.11.0-2_all.deb ... 570s Unpacking python3-py (1.11.0-2) ... 570s Selecting previously unselected package python3-zmq. 570s Preparing to unpack .../150-python3-zmq_24.0.1-5build2_arm64.deb ... 570s Unpacking python3-zmq (24.0.1-5build2) ... 571s Selecting previously unselected package python3-jupyter-client. 571s Preparing to unpack .../151-python3-jupyter-client_8.6.3-1_all.deb ... 571s Unpacking python3-jupyter-client (8.6.3-1) ... 571s Selecting previously unselected package python3-pythonjsonlogger. 571s Preparing to unpack .../152-python3-pythonjsonlogger_3.1.0-1_all.deb ... 571s Unpacking python3-pythonjsonlogger (3.1.0-1) ... 571s Selecting previously unselected package python3-rfc3339-validator. 571s Preparing to unpack .../153-python3-rfc3339-validator_0.1.4-2_all.deb ... 571s Unpacking python3-rfc3339-validator (0.1.4-2) ... 571s Selecting previously unselected package python3-rfc3986-validator. 571s Preparing to unpack .../154-python3-rfc3986-validator_0.1.1-2_all.deb ... 571s Unpacking python3-rfc3986-validator (0.1.1-2) ... 571s Selecting previously unselected package python3-uritemplate. 571s Preparing to unpack .../155-python3-uritemplate_4.1.1-3_all.deb ... 571s Unpacking python3-uritemplate (4.1.1-3) ... 571s Selecting previously unselected package python3-webcolors. 571s Preparing to unpack .../156-python3-webcolors_1.13-1_all.deb ... 571s Unpacking python3-webcolors (1.13-1) ... 571s Selecting previously unselected package python3-jupyter-events. 571s Preparing to unpack .../157-python3-jupyter-events_0.10.0-3_all.deb ... 571s Unpacking python3-jupyter-events (0.10.0-3) ... 571s Selecting previously unselected package python3-ptyprocess. 571s Preparing to unpack .../158-python3-ptyprocess_0.7.0-6_all.deb ... 571s Unpacking python3-ptyprocess (0.7.0-6) ... 571s Selecting previously unselected package python3-terminado. 571s Preparing to unpack .../159-python3-terminado_0.18.1-1_all.deb ... 571s Unpacking python3-terminado (0.18.1-1) ... 571s Selecting previously unselected package python3-jupyter-server-terminals. 571s Preparing to unpack .../160-python3-jupyter-server-terminals_0.5.3-2_all.deb ... 571s Unpacking python3-jupyter-server-terminals (0.5.3-2) ... 571s Selecting previously unselected package python3-jupyterlab-pygments. 571s Preparing to unpack .../161-python3-jupyterlab-pygments_0.2.2-3_all.deb ... 571s Unpacking python3-jupyterlab-pygments (0.2.2-3) ... 571s Selecting previously unselected package python3-mistune. 571s Preparing to unpack .../162-python3-mistune_3.0.2-2_all.deb ... 571s Unpacking python3-mistune (3.0.2-2) ... 571s Selecting previously unselected package python3-nbformat. 571s Preparing to unpack .../163-python3-nbformat_5.9.1-1_all.deb ... 571s Unpacking python3-nbformat (5.9.1-1) ... 572s Selecting previously unselected package python3-nbclient. 572s Preparing to unpack .../164-python3-nbclient_0.8.0-1_all.deb ... 572s Unpacking python3-nbclient (0.8.0-1) ... 572s Selecting previously unselected package python3-pandocfilters. 572s Preparing to unpack .../165-python3-pandocfilters_1.5.1-1_all.deb ... 572s Unpacking python3-pandocfilters (1.5.1-1) ... 572s Selecting previously unselected package python3-tinycss2. 572s Preparing to unpack .../166-python3-tinycss2_1.4.0-1_all.deb ... 572s Unpacking python3-tinycss2 (1.4.0-1) ... 572s Selecting previously unselected package python3-nbconvert. 572s Preparing to unpack .../167-python3-nbconvert_7.16.4-2_all.deb ... 572s Unpacking python3-nbconvert (7.16.4-2) ... 572s Selecting previously unselected package python3-overrides. 572s Preparing to unpack .../168-python3-overrides_7.7.0-2_all.deb ... 572s Unpacking python3-overrides (7.7.0-2) ... 572s Selecting previously unselected package python3-prometheus-client. 572s Preparing to unpack .../169-python3-prometheus-client_0.19.0+ds1-1_all.deb ... 572s Unpacking python3-prometheus-client (0.19.0+ds1-1) ... 572s Selecting previously unselected package python3-send2trash. 572s Preparing to unpack .../170-python3-send2trash_1.8.3-1_all.deb ... 572s Unpacking python3-send2trash (1.8.3-1) ... 572s Selecting previously unselected package python3-websocket. 572s Preparing to unpack .../171-python3-websocket_1.8.0-2_all.deb ... 572s Unpacking python3-websocket (1.8.0-2) ... 572s Selecting previously unselected package python3-jupyter-server. 572s Preparing to unpack .../172-python3-jupyter-server_2.14.2-4_all.deb ... 572s Unpacking python3-jupyter-server (2.14.2-4) ... 572s Selecting previously unselected package python3-numpy. 572s Preparing to unpack .../173-python3-numpy_1%3a1.26.4+ds-11ubuntu1_arm64.deb ... 572s Unpacking python3-numpy (1:1.26.4+ds-11ubuntu1) ... 572s Selecting previously unselected package python3-tabulate. 573s Preparing to unpack .../174-python3-tabulate_0.9.0-1_all.deb ... 573s Unpacking python3-tabulate (0.9.0-1) ... 573s Selecting previously unselected package python3-numpydoc. 573s Preparing to unpack .../175-python3-numpydoc_1.6.0-2_all.deb ... 573s Unpacking python3-numpydoc (1.6.0-2) ... 573s Selecting previously unselected package python3-tz. 573s Preparing to unpack .../176-python3-tz_2024.1-2_all.deb ... 573s Unpacking python3-tz (2024.1-2) ... 573s Selecting previously unselected package python3-pandas-lib:arm64. 573s Preparing to unpack .../177-python3-pandas-lib_2.2.3+dfsg-5ubuntu1_arm64.deb ... 573s Unpacking python3-pandas-lib:arm64 (2.2.3+dfsg-5ubuntu1) ... 573s Selecting previously unselected package python3-pandas. 573s Preparing to unpack .../178-python3-pandas_2.2.3+dfsg-5ubuntu1_all.deb ... 573s Unpacking python3-pandas (2.2.3+dfsg-5ubuntu1) ... 573s Selecting previously unselected package python3-pluggy. 573s Preparing to unpack .../179-python3-pluggy_1.5.0-1_all.deb ... 573s Unpacking python3-pluggy (1.5.0-1) ... 573s Selecting previously unselected package python3-pytest. 573s Preparing to unpack .../180-python3-pytest_8.3.3-1_all.deb ... 573s Unpacking python3-pytest (8.3.3-1) ... 573s Selecting previously unselected package python3-pytest-asyncio. 573s Preparing to unpack .../181-python3-pytest-asyncio_0.20.3-1.3_all.deb ... 573s Unpacking python3-pytest-asyncio (0.20.3-1.3) ... 573s Selecting previously unselected package python3-pytest-rerunfailures. 573s Preparing to unpack .../182-python3-pytest-rerunfailures_14.0-2_all.deb ... 573s Unpacking python3-pytest-rerunfailures (14.0-2) ... 573s Selecting previously unselected package python3-pytest-timeout. 573s Preparing to unpack .../183-python3-pytest-timeout_2.3.1-1_all.deb ... 573s Unpacking python3-pytest-timeout (2.3.1-1) ... 574s Selecting previously unselected package python3-sortedcollections. 574s Preparing to unpack .../184-python3-sortedcollections_2.1.0-2_all.deb ... 574s Unpacking python3-sortedcollections (2.1.0-2) ... 574s Selecting previously unselected package python3-sphinx-click. 574s Preparing to unpack .../185-python3-sphinx-click_5.1.0-1_all.deb ... 574s Unpacking python3-sphinx-click (5.1.0-1) ... 574s Selecting previously unselected package python3-sphinx-design. 574s Preparing to unpack .../186-python3-sphinx-design_0.6.1-1_all.deb ... 574s Unpacking python3-sphinx-design (0.6.1-1) ... 574s Selecting previously unselected package python3-versioneer. 574s Preparing to unpack .../187-python3-versioneer_0.29-1_all.deb ... 574s Unpacking python3-versioneer (0.29-1) ... 574s Selecting previously unselected package tzdata-legacy. 574s Preparing to unpack .../188-tzdata-legacy_2024b-1ubuntu2_all.deb ... 574s Unpacking tzdata-legacy (2024b-1ubuntu2) ... 574s Selecting previously unselected package uglifyjs. 574s Preparing to unpack .../189-uglifyjs_3.17.4-2_all.deb ... 574s Unpacking uglifyjs (3.17.4-2) ... 574s Selecting previously unselected package autopkgtest-satdep. 574s Preparing to unpack .../190-2-autopkgtest-satdep.deb ... 574s Unpacking autopkgtest-satdep (0) ... 574s Setting up dh-python (6.20241024) ... 574s Setting up node-uglify-js (3.17.4-2) ... 574s Setting up python3-iniconfig (1.1.1-2) ... 575s Setting up python3-sniffio (1.3.1-1) ... 575s Setting up python3-tornado (6.4.1-3) ... 576s Setting up libnorm1t64:arm64 (1.5.9+dfsg-3.1build1) ... 576s Setting up python3-send2trash (1.8.3-1) ... 576s Setting up fonts-lato (2.015-1) ... 576s Setting up libjs-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 576s Setting up fonts-mathjax (2.7.9+dfsg-1) ... 576s Setting up libsodium23:arm64 (1.0.18-1build3) ... 576s Setting up python3-async-generator (1.10-4) ... 576s Setting up libjs-mathjax (2.7.9+dfsg-1) ... 576s Setting up python3-tblib (3.0.0-5) ... 577s Setting up python3-py (1.11.0-2) ... 577s Setting up python3-anyio (4.6.2-4) ... 578s Setting up python3-pythonjsonlogger (3.1.0-1) ... 578s Setting up python3-colorama (0.4.6-4) ... 578s Setting up python3-defusedxml (0.7.1-2) ... 578s Setting up libarchive-zip-perl (1.68-1) ... 578s Setting up fonts-glyphicons-halflings (1.009~3.4.1+dfsg-3) ... 578s Setting up python3-alabaster (0.7.16-0.1) ... 579s Setting up libargon2-1:arm64 (0~20190702+dfsg-4build1) ... 579s Setting up python3-overrides (7.7.0-2) ... 579s Setting up libdebhelper-perl (13.20ubuntu1) ... 579s Setting up python3-fsspec (2024.9.0-1) ... 580s Setting up python3-rfc3339-validator (0.1.4-2) ... 580s Setting up python3-tabulate (0.9.0-1) ... 580s Setting up m4 (1.4.19-4build1) ... 580s Setting up node-cjs-module-lexer (1.2.3+dfsg-1) ... 580s Setting up python3-sortedcontainers (2.4.0-2) ... 581s Setting up python3-pandocfilters (1.5.1-1) ... 581s Setting up libgomp1:arm64 (14.2.0-8ubuntu1) ... 581s Setting up python3-click (8.1.7-2) ... 581s Setting up python3-wheel (0.45.0-1) ... 582s Setting up python3-webencodings (0.5.1-5) ... 582s Setting up python3-platformdirs (4.3.6-1) ... 582s Setting up python3-psutil (5.9.8-2build3) ... 583s Setting up tzdata-legacy (2024b-1ubuntu2) ... 583s Setting up python3-tz (2024.1-2) ... 583s Setting up python3-cloudpickle (3.0.0-2) ... 583s Setting up python3-uritemplate (4.1.1-3) ... 584s Setting up python3-jupyterlab-pygments (0.2.2-3) ... 584s Setting up libpython3.13-minimal:arm64 (3.13.0-2) ... 584s Setting up python3-roman (4.2-1) ... 584s Setting up libpgm-5.3-0t64:arm64 (5.3.128~dfsg-2.1build1) ... 584s Setting up python3-decorator (5.1.1-5) ... 584s Setting up python3-fqdn (1.5.1-2) ... 585s Setting up autotools-dev (20220109.1) ... 585s Setting up libblas3:arm64 (3.12.0-4) ... 585s update-alternatives: using /usr/lib/aarch64-linux-gnu/blas/libblas.so.3 to provide /usr/lib/aarch64-linux-gnu/libblas.so.3 (libblas.so.3-aarch64-linux-gnu) in auto mode 585s Setting up python3-webcolors (1.13-1) ... 585s Setting up python3-packaging (24.2-1) ... 585s Setting up python3-pyproject-hooks (1.2.0-1) ... 586s Setting up node-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 586s Setting up python3-snowballstemmer (2.2.0-4build1) ... 586s Setting up node-balanced-match (2.0.0-1) ... 586s Setting up node-brace-expansion (2.0.1+~1.1.0-1) ... 586s Setting up python3-rfc3986-validator (0.1.1-2) ... 587s Setting up libcares2:arm64 (1.34.2-1) ... 587s Setting up libmpc3:arm64 (1.3.1-1build2) ... 587s Setting up autopoint (0.22.5-2) ... 587s Setting up python3-html5lib (1.2-1) ... 587s Setting up python3-toml (0.10.2-1) ... 587s Setting up python3-installer (0.7.0+dfsg1-3) ... 588s Setting up libgfortran5:arm64 (14.2.0-8ubuntu1) ... 588s Setting up autoconf (2.72-3) ... 588s Setting up python3-pluggy (1.5.0-1) ... 588s Setting up libubsan1:arm64 (14.2.0-8ubuntu1) ... 588s Setting up python3-fastjsonschema (2.20.0-1) ... 588s Setting up node-undici (5.28.4+dfsg1+~cs23.12.11-2) ... 588s Setting up dwz (0.15-1build6) ... 588s Setting up libhwasan0:arm64 (14.2.0-8ubuntu1) ... 588s Setting up python3-traitlets (5.14.3+really5.14.3-1) ... 588s Setting up libasan8:arm64 (14.2.0-8ubuntu1) ... 588s Setting up python-tinycss2-common (1.4.0-1) ... 588s Setting up libjson-perl (4.10000-1) ... 588s Setting up python3-argon2 (21.1.0-2build1) ... 589s Setting up debugedit (1:5.1-1) ... 589s Setting up python3.13-minimal (3.13.0-2) ... 590s Setting up python3-toolz (1.0.0-1) ... 590s Setting up python3-dateutil (2.9.0-3) ... 590s Setting up sgml-base (1.31) ... 590s Setting up python3-msgpack (1.0.3-3build3) ... 591s Setting up python3-versioneer (0.29-1) ... 591s Setting up node-minimatch (9.0.3-5) ... 591s Setting up libtsan2:arm64 (14.2.0-8ubuntu1) ... 591s Setting up libjs-jquery (3.6.1+dfsg+~3.5.14-1) ... 591s Setting up sass-stylesheets-bulma (0.9.4~ds-1) ... 591s Setting up node-xtend (4.0.2-3) ... 591s Setting up libisl23:arm64 (0.27-1) ... 591s Setting up python3-build (1.2.2-1) ... 591s Setting up python3-zict (3.0.0-2ubuntu1) ... 591s Setting up python3-locket (1.0.0-2) ... 592s Setting up python3-mistune (3.0.2-2) ... 592s Setting up libpython3.13-stdlib:arm64 (3.13.0-2) ... 592s Setting up python3-soupsieve (2.6-1) ... 592s Setting up fonts-font-awesome (5.0.10+really4.7.0~dfsg-4.1) ... 592s Setting up sphinx-rtd-theme-common (3.0.2+dfsg-1) ... 592s Setting up python3-websocket (1.8.0-2) ... 592s Setting up libcc1-0:arm64 (14.2.0-8ubuntu1) ... 592s Setting up libjs-sortable-tablesort (3.1.0+ds-2) ... 592s Setting up python3-jupyter-core (5.7.2-4) ... 593s Setting up liblsan0:arm64 (14.2.0-8ubuntu1) ... 593s Setting up libjs-bootstrap (3.4.1+dfsg-3) ... 593s Setting up libitm1:arm64 (14.2.0-8ubuntu1) ... 593s Setting up libjs-underscore (1.13.4~dfsg+~1.11.4-3) ... 593s Setting up python3-imagesize (1.4.1-1) ... 593s Setting up python3-ptyprocess (0.7.0-6) ... 593s Setting up automake (1:1.16.5-1.3ubuntu1) ... 593s update-alternatives: using /usr/bin/automake-1.16 to provide /usr/bin/automake (automake) in auto mode 593s Setting up libfile-stripnondeterminism-perl (1.14.0-1) ... 593s Setting up python3-partd (1.4.2-1) ... 593s Setting up python3-sortedcollections (2.1.0-2) ... 594s Setting up liblapack3:arm64 (3.12.0-4) ... 594s update-alternatives: using /usr/lib/aarch64-linux-gnu/lapack/liblapack.so.3 to provide /usr/lib/aarch64-linux-gnu/liblapack.so.3 (liblapack.so.3-aarch64-linux-gnu) in auto mode 594s Setting up gettext (0.22.5-2) ... 594s Setting up python3-tinycss2 (1.4.0-1) ... 594s Setting up libzmq5:arm64 (4.3.5-1build2) ... 594s Setting up python3-arrow (1.3.0-1.1ubuntu1) ... 594s Setting up python3.13 (3.13.0-2) ... 595s Setting up pybuild-plugin-pyproject (6.20241024) ... 595s Setting up python3-pytest (8.3.3-1) ... 596s Setting up python3-dask (2024.5.2+dfsg-1) ... 599s Setting up python3-isoduration (20.11.0+git20211126.ae0bd61-2) ... 600s Setting up python3-all (3.12.7-1) ... 600s Setting up python3-nbformat (5.9.1-1) ... 600s Setting up python3-bs4 (4.12.3-3) ... 600s Setting up intltool-debian (0.35.0+20060710.6) ... 600s Setting up python3-bleach (6.2.0-1) ... 600s Setting up python3-prometheus-client (0.19.0+ds1-1) ... 601s Setting up python3-distributed (2024.5.2+ds.1-8) ... 604s Setting up python3-zmq (24.0.1-5build2) ... 604s Setting up python3-numpy (1:1.26.4+ds-11ubuntu1) ... 608s Setting up libjs-sphinxdoc (7.4.7-4) ... 608s Setting up python3-pytest-asyncio (0.20.3-1.3) ... 609s Setting up dh-strip-nondeterminism (1.14.0-1) ... 609s Setting up python3-terminado (0.18.1-1) ... 609s Setting up cpp-14-aarch64-linux-gnu (14.2.0-8ubuntu1) ... 609s Setting up xml-core (0.19) ... 609s Setting up python3-jupyter-client (8.6.3-1) ... 609s Setting up python3-jupyter-server-terminals (0.5.3-2) ... 609s Setting up libgcc-14-dev:arm64 (14.2.0-8ubuntu1) ... 609s Setting up python3.12-doc (3.12.7-3) ... 609s Setting up python3-jupyter-events (0.10.0-3) ... 610s Setting up libstdc++-14-dev:arm64 (14.2.0-8ubuntu1) ... 610s Setting up python3-doc (3.12.7-1) ... 610s Setting up python-numpy-doc (1:1.26.4+ds-11ubuntu1) ... 610s Setting up python3-pytest-rerunfailures (14.0-2) ... 610s Setting up python3-pytest-timeout (2.3.1-1) ... 610s Setting up python-pandas-doc (2.2.3+dfsg-5ubuntu1) ... 610s Setting up po-debconf (1.0.21+nmu1) ... 610s Setting up python3-pandas-lib:arm64 (2.2.3+dfsg-5ubuntu1) ... 610s Setting up python3-nbclient (0.8.0-1) ... 610s Setting up cpp-aarch64-linux-gnu (4:14.1.0-2ubuntu1) ... 610s Setting up python3-pandas (2.2.3+dfsg-5ubuntu1) ... 621s Setting up sphinx-common (7.4.7-4) ... 621s Setting up python-fsspec-doc (2024.9.0-1) ... 621s Setting up cpp-14 (14.2.0-8ubuntu1) ... 621s Setting up python3-nbconvert (7.16.4-2) ... 621s Setting up cpp (4:14.1.0-2ubuntu1) ... 621s Setting up gcc-14-aarch64-linux-gnu (14.2.0-8ubuntu1) ... 621s Setting up gcc-aarch64-linux-gnu (4:14.1.0-2ubuntu1) ... 621s Setting up g++-14-aarch64-linux-gnu (14.2.0-8ubuntu1) ... 621s Setting up python3-jupyter-server (2.14.2-4) ... 621s Setting up gcc-14 (14.2.0-8ubuntu1) ... 621s Setting up g++-aarch64-linux-gnu (4:14.1.0-2ubuntu1) ... 621s Setting up g++-14 (14.2.0-8ubuntu1) ... 621s Setting up libtool (2.4.7-8) ... 621s Setting up gcc (4:14.1.0-2ubuntu1) ... 621s Setting up dh-autoreconf (20) ... 621s Setting up g++ (4:14.1.0-2ubuntu1) ... 621s update-alternatives: using /usr/bin/g++ to provide /usr/bin/c++ (c++) in auto mode 621s Setting up build-essential (12.10ubuntu1) ... 621s Setting up debhelper (13.20ubuntu1) ... 621s Setting up pybuild-plugin-autopkgtest (6.20241024) ... 621s Setting up node-acorn (8.8.1+ds+~cs25.17.7-2) ... 621s Setting up libnode115:arm64 (20.18.0+dfsg-2) ... 621s Setting up nodejs (20.18.0+dfsg-2) ... 621s update-alternatives: using /usr/bin/nodejs to provide /usr/bin/js (js) in auto mode 621s Setting up node-argparse (2.0.1-2) ... 621s Setting up node-esprima (4.0.1+ds+~4.0.3-2) ... 621s Setting up node-js-yaml (4.1.0+dfsg+~4.0.5-7) ... 621s Setting up uglifyjs (3.17.4-2) ... 621s Setting up python-dask-doc (2024.5.2+dfsg-1) ... 621s Setting up python-distributed-doc (2024.5.2+ds.1-8) ... 621s Processing triggers for install-info (7.1.1-1) ... 622s Processing triggers for libc-bin (2.40-1ubuntu3) ... 622s Processing triggers for systemd (256.5-2ubuntu4) ... 622s Processing triggers for man-db (2.13.0-1) ... 623s Processing triggers for sgml-base (1.31) ... 623s Setting up docutils-common (0.21.2+dfsg-2) ... 623s Processing triggers for sgml-base (1.31) ... 623s Setting up python3-docutils (0.21.2+dfsg-2) ... 624s Setting up python3-sphinx (7.4.7-4) ... 626s Setting up python3-sphinx-click (5.1.0-1) ... 626s Setting up python3-sphinx-design (0.6.1-1) ... 626s Setting up python3-numpydoc (1.6.0-2) ... 626s Setting up python3-pydata-sphinx-theme (0.15.4+dfsg-2) ... 626s Setting up python3-sphinx-book-theme (0.1.7-3) ... 627s Setting up python3-dask-sphinx-theme (3.0.5-2) ... 627s Setting up autopkgtest-satdep (0) ... 635s (Reading database ... 110306 files and directories currently installed.) 635s Removing autopkgtest-satdep (0) ... 637s autopkgtest [00:28:08]: test pybuild-autopkgtest: pybuild-autopkgtest 637s autopkgtest [00:28:08]: test pybuild-autopkgtest: [----------------------- 637s pybuild-autopkgtest 638s I: pybuild pybuild:308: mkdir -pv /tmp/autopkgtest.Vx887U/autopkgtest_tmp/.config && printf '\173 "dataframe": \173 "query-planning": False \175 \175\n' > /tmp/autopkgtest.Vx887U/autopkgtest_tmp/.config/dask 638s mkdir: created directory '/tmp/autopkgtest.Vx887U/autopkgtest_tmp/.config' 638s I: pybuild base:311: cd /tmp/autopkgtest.Vx887U/autopkgtest_tmp/build; cd /tmp/autopkgtest.Vx887U/autopkgtest_tmp/build; /tmp/autopkgtest.Vx887U/build.kfb/src/debian/run-tests /tmp/autopkgtest.Vx887U/build.kfb/src/debian/get-test-exclusions rules python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m "not avoid_ci" 638s *** STARTING RUN 1: python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rsfE --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=cli/tests/test_dask_scheduler.py::test_defaults --deselect=cli/tests/test_dask_scheduler.py::test_hostport --deselect=cli/tests/test_dask_spec.py::test_errors --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=dashboard/tests/test_worker_bokeh.py::test_counters --deselect=deploy/tests/test_local.py::test_adapt_then_manual --deselect=deploy/tests/test_local.py::test_async_with --deselect=deploy/tests/test_local.py::test_close_twice --deselect=deploy/tests/test_local.py::test_cluster_info_sync --deselect=deploy/tests/test_local.py::test_local_tls --deselect=deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=deploy/tests/test_local.py::test_only_local_access --deselect=deploy/tests/test_local.py::test_remote_access --deselect=diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=protocol/tests/test_serialize.py::test_errors --deselect=tests/test_batched.py::test_BatchedSend --deselect=tests/test_batched.py::test_close_closed --deselect=tests/test_batched.py::test_close_twice --deselect=tests/test_batched.py::test_send_after_stream_start --deselect=tests/test_batched.py::test_send_before_close --deselect=tests/test_batched.py::test_send_before_start --deselect=tests/test_batched.py::test_sending_traffic_jam --deselect=tests/test_batched.py::test_serializers --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_async_with --deselect=tests/test_client.py::test_client_is_quiet_cluster_close --deselect=tests/test_client.py::test_dashboard_link_cluster --deselect=tests/test_client.py::test_dashboard_link_inproc --deselect=tests/test_client.py::test_file_descriptors_dont_leak --deselect=tests/test_client.py::test_mixing_clients_different_scheduler --deselect=tests/test_client.py::test_quiet_client_close --deselect=tests/test_client.py::test_rebalance_sync --deselect=tests/test_client.py::test_repr_localcluster --deselect=tests/test_client.py::test_security_loader --deselect=tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_shutdown --deselect=tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=tests/test_client.py::test_shutdown_localcluster --deselect=tests/test_client.py::test_shutdown_stops_callbacks --deselect=tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=tests/test_core.py::test_close_fast_without_active_handlers --deselect=tests/test_core.py::test_close_grace_period_for_handlers --deselect=tests/test_core.py::test_close_properly --deselect=tests/test_core.py::test_compression --deselect=tests/test_core.py::test_connection_pool --deselect=tests/test_core.py::test_connection_pool_close_while_connecting --deselect=tests/test_core.py::test_connection_pool_detects_remote_close --deselect=tests/test_core.py::test_connection_pool_outside_cancellation --deselect=tests/test_core.py::test_connection_pool_remove --deselect=tests/test_core.py::test_connection_pool_respects_limit --deselect=tests/test_core.py::test_connection_pool_tls --deselect=tests/test_core.py::test_counters --deselect=tests/test_core.py::test_deserialize_error --deselect=tests/test_core.py::test_errors --deselect=tests/test_core.py::test_identity_inproc --deselect=tests/test_core.py::test_identity_tcp --deselect=tests/test_core.py::test_large_packets_inproc --deselect=tests/test_core.py::test_messages_are_ordered_bsend --deselect=tests/test_core.py::test_messages_are_ordered_raw --deselect=tests/test_core.py::test_ports --deselect=tests/test_core.py::test_rpc_default --deselect=tests/test_core.py::test_rpc_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_default --deselect=tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=tests/test_core.py::test_rpc_serialization --deselect=tests/test_core.py::test_rpc_tcp --deselect=tests/test_core.py::test_rpc_tls --deselect=tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=tests/test_core.py::test_send_recv_args --deselect=tests/test_core.py::test_send_recv_cancelled --deselect=tests/test_core.py::test_server --deselect=tests/test_core.py::test_server_comms_mark_active_handlers --deselect=tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_locks.py::test_errors --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=tests/test_preload.py::test_preload_import_time --deselect=tests/test_preload.py::test_preload_manager_sequence --deselect=tests/test_preload.py::test_worker_preload_text --deselect=tests/test_scheduler.py::test_allowed_failures_config --deselect=tests/test_scheduler.py::test_async_context_manager --deselect=tests/test_scheduler.py::test_dashboard_host --deselect=tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=tests/test_scheduler.py::test_finished --deselect=tests/test_scheduler.py::test_multiple_listeners --deselect=tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_security.py::test_require_encryption --deselect=tests/test_security.py::test_tls_listen_connect --deselect=tests/test_security.py::test_tls_temporary_credentials_functional --deselect=tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=tests/test_utils_test.py::test_ensure_no_new_clients --deselect=tests/test_utils_test.py::test_freeze_batched_send --deselect=tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=tests/test_worker.py::test_plugin_exception --deselect=tests/test_worker.py::test_plugin_internal_exception --deselect=tests/test_worker.py::test_plugin_multiple_exceptions --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker_client.py::test_dont_override_default_get 639s ============================= test session starts ============================== 639s platform linux -- Python 3.13.0, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.13 639s cachedir: .pytest_cache 639s rootdir: /tmp/autopkgtest.Vx887U/autopkgtest_tmp/build 639s configfile: pyproject.toml 639s plugins: typeguard-4.4.1, timeout-2.3.1, rerunfailures-14.0, anyio-4.6.2 639s timeout: 300.0s 639s timeout method: signal 639s timeout func_only: False 648s collecting ... collected 3349 items / 159 deselected / 30 skipped / 3190 selected 648s 648s cli/tests/test_dask_scheduler.py::test_dashboard <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 648s cli/tests/test_dask_scheduler.py::test_dashboard_non_standard_ports <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 651s cli/tests/test_dask_scheduler.py::test_multiple_protocols <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 651s cli/tests/test_dask_scheduler.py::test_dashboard_allowlist <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 653s cli/tests/test_dask_scheduler.py::test_interface <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 656s cli/tests/test_dask_scheduler.py::test_pid_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 657s cli/tests/test_dask_scheduler.py::test_scheduler_port_zero <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 657s cli/tests/test_dask_scheduler.py::test_dashboard_port_zero <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 658s cli/tests/test_dask_scheduler.py::test_preload_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 0%] 659s cli/tests/test_dask_scheduler.py::test_preload_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 0%] 661s cli/tests/test_dask_scheduler.py::test_preload_remote_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 0%] 662s cli/tests/test_dask_scheduler.py::test_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 0%] 663s cli/tests/test_dask_scheduler.py::test_preload_command <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 0%] 664s cli/tests/test_dask_scheduler.py::test_preload_command_default <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 0%] 664s cli/tests/test_dask_scheduler.py::test_version_option <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 664s cli/tests/test_dask_scheduler.py::test_idle_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 664s cli/tests/test_dask_scheduler.py::test_restores_signal_handler <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 666s cli/tests/test_dask_scheduler.py::test_multiple_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 0%] 669s cli/tests/test_dask_scheduler.py::test_multiple_workers <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 669s cli/tests/test_dask_scheduler.py::test_signal_handling[2] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 669s cli/tests/test_dask_scheduler.py::test_signal_handling[15] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 670s cli/tests/test_dask_scheduler.py::test_single_executable_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 672s cli/tests/test_dask_spec.py::test_text <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 673s cli/tests/test_dask_spec.py::test_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 674s cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 675s cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 677s cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 678s cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 679s cli/tests/test_dask_spec.py::test_signal_handling_scheduler[2] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 680s cli/tests/test_dask_spec.py::test_signal_handling_scheduler[15] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args0-expect0] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 0%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args1-expect1] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args2-expect2] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args3-expect3] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args4-expect4] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args5-expect5] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args6-expect6] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args7-expect7] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args8-expect8] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args9-expect9] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args10-expect10] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args11-expect11] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args12-expect12] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args13-expect13] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args14-expect14] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args15-expect15] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args16-expect16] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_apportion_ports[args17-expect17] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_apportion_ports_bad <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 680s cli/tests/test_dask_worker.py::test_nanny_worker_ports <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 680s cli/tests/test_dask_worker.py::test_nanny_worker_port_range <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 682s cli/tests/test_dask_worker.py::test_nanny_worker_port_range_too_many_workers_raises <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 682s cli/tests/test_dask_worker.py::test_memory_limit <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 683s cli/tests/test_dask_worker.py::test_no_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 683s cli/tests/test_dask_worker.py::test_resources <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 683s cli/tests/test_dask_worker.py::test_local_directory[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 683s cli/tests/test_dask_worker.py::test_local_directory[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 683s cli/tests/test_dask_worker.py::test_scheduler_address_env <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 684s cli/tests/test_dask_worker.py::test_nworkers_requires_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 684s cli/tests/test_dask_worker.py::test_nworkers_negative <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 684s cli/tests/test_dask_worker.py::test_nworkers_auto <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 684s cli/tests/test_dask_worker.py::test_nworkers_expands_name <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 684s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://0.0.0.0:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 684s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://0.0.0.0:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://127.0.0.2:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://127.0.0.2:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://[::1]:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://[::1]:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_respect_host_listen_address[127.0.0.2---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_respect_host_listen_address[127.0.0.2---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_respect_host_listen_address[0.0.0.0---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_respect_host_listen_address[0.0.0.0---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_dashboard_non_standard_ports <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_version_option <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 684s cli/tests/test_dask_worker.py::test_worker_timeout[True] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_worker_timeout[False] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_integer_names <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_worker_class[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_worker_class[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_set_lifetime_stagger_via_env_var <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_set_lifetime_restart_via_env_var <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_timeout[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 684s cli/tests/test_dask_worker.py::test_timeout[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 686s cli/tests/test_dask_worker.py::test_signal_handling[2---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 687s cli/tests/test_dask_worker.py::test_signal_handling[2---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 689s cli/tests/test_dask_worker.py::test_signal_handling[15---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 690s cli/tests/test_dask_worker.py::test_signal_handling[15---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 695s cli/tests/test_dask_worker.py::test_error_during_startup[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 698s cli/tests/test_dask_worker.py::test_error_during_startup[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 700s cli/tests/test_dask_worker.py::test_single_executable_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 700s cli/tests/test_dask_worker.py::test_single_executable_works <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 702s cli/tests/test_tls_cli.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 2%] 704s cli/tests/test_tls_cli.py::test_sni <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 3%] 708s cli/tests/test_tls_cli.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 3%] 710s cli/tests/test_tls_cli.py::test_separate_key_cert <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 3%] 712s cli/tests/test_tls_cli.py::test_use_config_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 3%] 712s comm/tests/test_tcp.py::test_getaddrinfo_invalid_af <- ../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_tcp.py PASSED [ 3%] 712s dashboard/tests/test_bokeh.py::test_old_import <- ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_bokeh.py PASSED [ 3%] 712s deploy/tests/test_adaptive_core.py::test_safe_target <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 712s deploy/tests/test_adaptive_core.py::test_scale_up <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 712s deploy/tests/test_adaptive_core.py::test_scale_down <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 712s deploy/tests/test_adaptive_core.py::test_interval <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 712s deploy/tests/test_adaptive_core.py::test_adapt_oserror_safe_target <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 712s deploy/tests/test_adaptive_core.py::test_adapt_oserror_scale <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 712s deploy/tests/test_adaptive_core.py::test_adapt_stop_del <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 712s deploy/tests/test_cluster.py::test_eq <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 712s deploy/tests/test_cluster.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 715s deploy/tests/test_cluster.py::test_cluster_wait_for_worker <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 715s deploy/tests/test_cluster.py::test_deprecated_loop_properties <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 715s deploy/tests/test_cluster.py::test_exponential_backoff <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 715s deploy/tests/test_cluster.py::test_sync_context_manager_used_with_async_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 715s deploy/tests/test_deploy_utils.py::test_default_process_thread_breakdown <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_deploy_utils.py PASSED [ 3%] 717s deploy/tests/test_subprocess.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py FAILED [ 3%] 719s deploy/tests/test_subprocess.py::test_n_workers <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py FAILED [ 3%] 721s deploy/tests/test_subprocess.py::test_scale_up_and_down <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 3%] 724s deploy/tests/test_subprocess.py::test_raise_if_scheduler_fails_to_start <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 3%] 724s deploy/tests/test_subprocess.py::test_subprocess_cluster_does_not_depend_on_logging <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py SKIPPED [ 3%] 724s deploy/tests/test_subprocess.py::test_raise_on_windows <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py SKIPPED [ 3%] 726s diagnostics/tests/test_cluster_dump_plugin.py::test_cluster_dump_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_cluster_dump_plugin.py PASSED [ 3%] 726s diagnostics/tests/test_eventstream.py::test_eventstream <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py SKIPPED [ 3%] 726s diagnostics/tests/test_eventstream.py::test_eventstream_remote <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py PASSED [ 3%] 726s diagnostics/tests/test_graph_layout.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 726s diagnostics/tests/test_graph_layout.py::test_construct_after_call <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 726s diagnostics/tests/test_graph_layout.py::test_states <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 726s diagnostics/tests/test_graph_layout.py::test_release_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 4%] 726s diagnostics/tests/test_graph_layout.py::test_forget <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 4%] 726s diagnostics/tests/test_graph_layout.py::test_unique_positions <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 4%] 726s diagnostics/tests/test_graph_layout.py::test_layout_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 4%] 726s diagnostics/tests/test_install_plugin.py::test_pip_install <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 727s diagnostics/tests/test_install_plugin.py::test_conda_install <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 727s diagnostics/tests/test_install_plugin.py::test_pip_install_fails <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 727s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_not_found <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 727s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 727s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_on_returncode <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 727s diagnostics/tests/test_install_plugin.py::test_package_install_restarts_on_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py SKIPPED [ 4%] 728s diagnostics/tests/test_install_plugin.py::test_package_install_failing_does_not_restart_on_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 728s diagnostics/tests/test_memory_sampler.py::test_async <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 730s diagnostics/tests/test_memory_sampler.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 730s diagnostics/tests/test_memory_sampler.py::test_at_least_one_sample <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 730s diagnostics/tests/test_memory_sampler.py::test_multi_sample <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 730s diagnostics/tests/test_memory_sampler.py::test_pandas[False] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 730s diagnostics/tests/test_memory_sampler.py::test_pandas[True] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 730s diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[False] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 730s diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[True] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 732s diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 733s diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 734s diagnostics/tests/test_nanny_plugin.py::test_duck_typed_register_nanny_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 735s diagnostics/tests/test_nanny_plugin.py::test_register_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 736s diagnostics/tests/test_nanny_plugin.py::test_register_non_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 738s diagnostics/tests/test_nanny_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 738s diagnostics/tests/test_progress.py::test_many_Progress <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 738s diagnostics/tests/test_progress.py::test_multiprogress <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 738s diagnostics/tests/test_progress.py::test_multiprogress_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 738s diagnostics/tests/test_progress.py::test_multiprogress_with_spans <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 738s diagnostics/tests/test_progress.py::test_multiprogress_with_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 738s diagnostics/tests/test_progress.py::test_multiprogress_warns <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 738s diagnostics/tests/test_progress.py::test_robust_to_bad_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 742s diagnostics/tests/test_progress.py::test_AllProgress <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 744s diagnostics/tests/test_progress.py::test_AllProgress_lost_key <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 748s diagnostics/tests/test_progress.py::test_group_timing <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 750s diagnostics/tests/test_progressbar.py::test_text_progressbar <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 750s diagnostics/tests/test_progressbar.py::test_TextProgressBar_error <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 750s diagnostics/tests/test_progressbar.py::test_TextProgressBar_empty <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 751s diagnostics/tests/test_progressbar.py::test_progress_function <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 753s diagnostics/tests/test_progressbar.py::test_progress_function_w_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 754s diagnostics/tests/test_progressbar.py::test_progress_function_warns <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 754s diagnostics/tests/test_progressbar.py::test_progress_function_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 754s diagnostics/tests/test_progressbar.py::test_deprecated_loop_properties <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 754s diagnostics/tests/test_scheduler_plugin.py::test_simple <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 754s diagnostics/tests/test_scheduler_plugin.py::test_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 754s diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_renamed_kwargs_allowed <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 754s diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_without_kwargs_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 754s diagnostics/tests/test_scheduler_plugin.py::test_async_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 754s diagnostics/tests/test_scheduler_plugin.py::test_async_and_sync_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 754s diagnostics/tests/test_scheduler_plugin.py::test_failing_async_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 754s diagnostics/tests/test_scheduler_plugin.py::test_failing_sync_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 754s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 754s diagnostics/tests/test_scheduler_plugin.py::test_register_scheduler_plugin_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 754s diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 755s diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin_from_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 755s diagnostics/tests/test_scheduler_plugin.py::test_log_event_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 755s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_on_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 757s diagnostics/tests/test_scheduler_plugin.py::test_closing_errors_ok <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 757s diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_simple <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 757s diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_complex <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 757s diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 758s diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 758s diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 758s diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 758s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 758s diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugins_directly <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 758s diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugins_directly <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 758s diagnostics/tests/test_task_stream.py::test_TaskStreamPlugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 758s diagnostics/tests/test_task_stream.py::test_maxlen <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 759s diagnostics/tests/test_task_stream.py::test_collect <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 759s diagnostics/tests/test_task_stream.py::test_no_startstops <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 760s diagnostics/tests/test_task_stream.py::test_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 762s diagnostics/tests/test_task_stream.py::test_client_sync <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 762s diagnostics/tests/test_task_stream.py::test_get_task_stream_plot <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py SKIPPED [ 6%] 764s diagnostics/tests/test_task_stream.py::test_get_task_stream_save <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py SKIPPED [ 6%] 764s diagnostics/tests/test_worker_plugin.py::test_create_with_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 764s diagnostics/tests/test_worker_plugin.py::test_remove_with_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 764s diagnostics/tests/test_worker_plugin.py::test_remove_with_client_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 764s diagnostics/tests/test_worker_plugin.py::test_create_on_construction <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 764s diagnostics/tests/test_worker_plugin.py::test_normal_task_transitions_called <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 764s diagnostics/tests/test_worker_plugin.py::test_failing_task_transitions_called <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 764s diagnostics/tests/test_worker_plugin.py::test_superseding_task_transitions_called <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 765s diagnostics/tests/test_worker_plugin.py::test_dependent_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 765s diagnostics/tests/test_worker_plugin.py::test_empty_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 765s diagnostics/tests/test_worker_plugin.py::test_default_name <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 765s diagnostics/tests/test_worker_plugin.py::test_assert_no_warning_no_overload <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 765s diagnostics/tests/test_worker_plugin.py::test_WorkerPlugin_overwrite <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 765s diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 765s diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 765s diagnostics/tests/test_worker_plugin.py::test_duck_typed_register_worker_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 765s diagnostics/tests/test_worker_plugin.py::test_register_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 765s diagnostics/tests/test_worker_plugin.py::test_register_non_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 766s diagnostics/tests/test_worker_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 766s http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_low <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py SKIPPED [ 6%] 766s http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_high <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py SKIPPED [ 6%] 766s http/scheduler/tests/test_scheduler_http.py::test_connect <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 766s http/scheduler/tests/test_scheduler_http.py::test_worker_404 <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 766s http/scheduler/tests/test_scheduler_http.py::test_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 7%] 766s http/scheduler/tests/test_scheduler_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 767s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_states <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 767s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_prefix_counts <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 767s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_worker_states <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 767s http/scheduler/tests/test_scheduler_http.py::test_health <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 7%] 768s http/scheduler/tests/test_scheduler_http.py::test_sitemap <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 768s http/scheduler/tests/test_scheduler_http.py::test_task_page[1_0] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 768s http/scheduler/tests/test_scheduler_http.py::test_task_page[1_1] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 768s http/scheduler/tests/test_scheduler_http.py::test_task_page[x] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 768s http/scheduler/tests/test_scheduler_http.py::test_task_page[a+b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 768s http/scheduler/tests/test_scheduler_http.py::test_task_page[a b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 768s http/scheduler/tests/test_scheduler_http.py::test_task_page[key5] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 768s http/scheduler/tests/test_scheduler_http.py::test_task_page[key6] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 768s http/scheduler/tests/test_scheduler_http.py::test_task_page[key7] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 768s http/scheduler/tests/test_scheduler_http.py::test_task_page[key8] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 768s http/scheduler/tests/test_scheduler_http.py::test_task_page[(] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 768s http/scheduler/tests/test_scheduler_http.py::test_task_page[[] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 768s http/scheduler/tests/test_scheduler_http.py::test_task_page['] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 768s http/scheduler/tests/test_scheduler_http.py::test_task_page["] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 768s http/scheduler/tests/test_scheduler_http.py::test_task_page[123] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 768s http/scheduler/tests/test_scheduler_http.py::test_task_page[key14] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 768s http/scheduler/tests/test_scheduler_http.py::test_task_page[key15] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 769s http/scheduler/tests/test_scheduler_http.py::test_task_page[key16] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 769s http/scheduler/tests/test_scheduler_http.py::test_task_page[key17] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 769s http/scheduler/tests/test_scheduler_http.py::test_task_page[key18] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 769s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_0] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 769s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_1] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 769s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[x] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 769s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a+b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 769s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 769s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key5] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 769s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key6] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 769s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key7] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 769s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key8] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 769s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[(] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 770s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[[] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 770s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page['] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 770s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page["] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 770s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[123] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 770s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key14] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 770s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key15] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 770s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key16] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 770s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key17] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 770s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key18] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 770s http/scheduler/tests/test_scheduler_http.py::test_allow_websocket_origin <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 770s http/scheduler/tests/test_scheduler_http.py::test_eventstream <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 770s http/scheduler/tests/test_scheduler_http.py::test_api_disabled_by_default <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 770s http/scheduler/tests/test_scheduler_http.py::test_api <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 770s http/scheduler/tests/test_scheduler_http.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 770s http/scheduler/tests/test_scheduler_http.py::test_get_workers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 770s http/scheduler/tests/test_scheduler_http.py::test_adaptive_target <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 770s http/scheduler/tests/test_scheduler_http.py::test_check_idle <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 771s http/scheduler/tests/test_semaphore_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_semaphore_http.py PASSED [ 8%] 771s http/scheduler/tests/test_semaphore_http.py::test_prometheus_without_semaphore_extension <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_semaphore_http.py PASSED [ 8%] 771s http/scheduler/tests/test_stealing_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 771s http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_count_total_by_cost_multipliers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 772s http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_cost_total_by_cost_multipliers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 772s http/scheduler/tests/test_stealing_http.py::test_prometheus_without_stealing_extension <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 772s http/tests/test_core.py::test_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/http/tests/test_core.py PASSED [ 8%] 772s http/tests/test_routing.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/http/tests/test_routing.py PASSED [ 8%] 772s http/worker/tests/test_worker_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 8%] 772s http/worker/tests/test_worker_http.py::test_metrics_when_prometheus_client_not_installed <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 772s http/worker/tests/test_worker_http.py::test_prometheus_collect_task_states <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 772s http/worker/tests/test_worker_http.py::test_health <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py SKIPPED [ 9%] 772s http/worker/tests/test_worker_http.py::test_sitemap <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py SKIPPED [ 9%] 772s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 772s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_spill_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 772s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_bogus_sizeof <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py SKIPPED [ 9%] 772s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 772s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 772s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-list] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 772s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 772s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 772s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-list] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 772s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 772s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 772s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-list] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 772s protocol/tests/test_collection.py::test_large_collections_serialize_simply <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 772s protocol/tests/test_collection.py::test_nested_types <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 772s protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 772s protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 772s protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 772s protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 772s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 772s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 772s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 772s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 772s protocol/tests/test_compression.py::test_get_compression_settings <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 772s protocol/tests/test_compression.py::test_auto_compression <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 772s protocol/tests/test_compression.py::test_compression_1 <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 772s protocol/tests/test_compression.py::test_compression_2 <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 773s protocol/tests/test_compression.py::test_compression_3 <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 773s protocol/tests/test_compression.py::test_compression_without_deserialization <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 773s protocol/tests/test_compression.py::test_lz4_decompression_avoids_deep_copy <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress[None-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress[None-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress[zlib-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress[zlib-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress[lz4-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress[lz4-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress[snappy-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress[snappy-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress[zstd-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress[zstd-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress_sample[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress_sample[zlib] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress_sample[lz4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress_sample[snappy] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress_sample[zstd] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zlib] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[lz4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[snappy] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zstd] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_maybe_compress_auto <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 773s protocol/tests/test_compression.py::test_compression_thread_safety[None-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_compression_thread_safety[None-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_compression_thread_safety[zlib-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_compression_thread_safety[zlib-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_compression_thread_safety[lz4-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_compression_thread_safety[lz4-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_compression_thread_safety[snappy-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_compression_thread_safety[snappy-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_compression_thread_safety[zstd-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 773s protocol/tests/test_compression.py::test_compression_thread_safety[zstd-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 773s protocol/tests/test_compression.py::test_large_messages[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 773s protocol/tests/test_compression.py::test_large_messages[zlib] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 773s protocol/tests/test_compression.py::test_large_messages[lz4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 773s protocol/tests/test_compression.py::test_large_messages[snappy] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 773s protocol/tests/test_compression.py::test_large_messages[zstd] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 773s protocol/tests/test_compression.py::test_loads_without_deserialization_avoids_compression <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 773s protocol/tests/test_compression.py::test_compress_remote_comms <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 773s protocol/tests/test_compression.py::test_disable_compression_on_localhost[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 774s protocol/tests/test_compression.py::test_disable_compression_on_localhost[127.0.0.1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 774s protocol/tests/test_compression.py::test_disable_compression_on_localhost[localhost] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 774s protocol/tests/test_highlevelgraph.py::test_combo_of_layer_types <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 774s protocol/tests/test_highlevelgraph.py::test_blockwise <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 775s protocol/tests/test_highlevelgraph.py::test_shuffle <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 775s protocol/tests/test_highlevelgraph.py::test_array_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 775s protocol/tests/test_highlevelgraph.py::test_dataframe_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 775s protocol/tests/test_numpy.py::test_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x6] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x7] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x9] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x10] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x11] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x13] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x14] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x15] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x16] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x17] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x18] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x19] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x20] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x21] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x22] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x23] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x24] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x25] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x26] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x27] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x28] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x29] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x30] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x31] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x32] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x33] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x34] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x35] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x36] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_numpy_writable[True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_numpy_writable[False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy_custom_dtype <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py SKIPPED [ 12%] 775s protocol/tests/test_numpy.py::test_memmap <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 775s protocol/tests/test_numpy.py::test_dumps_serialize_numpy_large <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py SKIPPED [ 13%] 775s protocol/tests/test_numpy.py::test_itemsize[f8-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 775s protocol/tests/test_numpy.py::test_itemsize[i4-4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 775s protocol/tests/test_numpy.py::test_itemsize[c16-16] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 775s protocol/tests/test_numpy.py::test_itemsize[b-1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 775s protocol/tests/test_numpy.py::test_itemsize[S3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 775s protocol/tests/test_numpy.py::test_itemsize[M8[us]-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 775s protocol/tests/test_numpy.py::test_itemsize[M8[s]-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 775s protocol/tests/test_numpy.py::test_itemsize[U3-12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 775s protocol/tests/test_numpy.py::test_itemsize[dt8-12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 775s protocol/tests/test_numpy.py::test_itemsize[dt9-4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 775s protocol/tests/test_numpy.py::test_itemsize[dt10-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 775s protocol/tests/test_numpy.py::test_itemsize[dt11-88] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 775s protocol/tests/test_numpy.py::test_itemsize[dt12-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 775s protocol/tests/test_numpy.py::test_compress_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 775s protocol/tests/test_numpy.py::test_compress_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 776s protocol/tests/test_numpy.py::test_dumps_large <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 776s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 776s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 776s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 776s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 776s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 776s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 776s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 776s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 776s protocol/tests/test_numpy.py::test_non_zero_strided_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 776s protocol/tests/test_numpy.py::test_serialize_writeable_array_readonly_base_object <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 13%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 13%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 13%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 13%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df6] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df7] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df9] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df10] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df11] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df13] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df14] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df15] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df16] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df17] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df18] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df19] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df20] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df21] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df22] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df23] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df24] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df25] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pandas.py::test_dumps_pandas_writable <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 776s protocol/tests/test_pickle.py::test_pickle_data[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 776s protocol/tests/test_pickle.py::test_pickle_data[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 776s protocol/tests/test_pickle.py::test_pickle_out_of_band[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 776s protocol/tests/test_pickle.py::test_pickle_out_of_band[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 776s protocol/tests/test_pickle.py::test_pickle_empty[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 776s protocol/tests/test_pickle.py::test_pickle_empty[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 776s protocol/tests/test_pickle.py::test_pickle_numpy[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 776s protocol/tests/test_pickle.py::test_pickle_numpy[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 776s protocol/tests/test_pickle.py::test_pickle_functions[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 776s protocol/tests/test_pickle.py::test_pickle_functions[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 776s protocol/tests/test_pickle.py::test_pickle_by_value_when_registered <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 776s protocol/tests/test_pickle.py::test_allow_pickle_if_registered_in_dask_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 776s protocol/tests/test_pickle.py::test_nopickle_nested <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 776s protocol/tests/test_pickle.py::test_pickle_functions_in_main <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py SKIPPED [ 15%] 776s protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[dask] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 776s protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[pickle] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 776s protocol/tests/test_protocol.py::test_protocol <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 776s protocol/tests/test_protocol.py::test_small <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 776s protocol/tests/test_protocol.py::test_small_and_big <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 776s protocol/tests/test_protocol.py::test_large_bytes[bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 776s protocol/tests/test_protocol.py::test_large_bytes[memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 776s protocol/tests/test_protocol.py::test_large_messages_map <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 776s protocol/tests/test_protocol.py::test_loads_deserialize_False <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 776s protocol/tests/test_protocol.py::test_dumps_loads_Serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 776s protocol/tests/test_protocol.py::test_dumps_loads_Serialized <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 776s protocol/tests/test_protocol.py::test_preserve_header[serializers0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 776s protocol/tests/test_protocol.py::test_preserve_header[serializers1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 776s protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 776s protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 776s protocol/tests/test_protocol.py::test_sizeof_serialize[ToPickle-Pickled] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 776s protocol/tests/test_protocol.py::test_fallback_to_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 776s protocol/tests/test_protocol.py::test_large_payload[bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py SKIPPED [ 15%] 776s protocol/tests/test_protocol.py::test_large_payload[str] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py SKIPPED [ 15%] 776s protocol/tests/test_protocol.py::test_large_payload[ext] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py SKIPPED [ 15%] 776s protocol/tests/test_protocol_utils.py::test_pack_frames <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 776s protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[456] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 776s protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 776s protocol/tests/test_protocol_utils.py::test_unpack_frames_partial <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_empty <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_one <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices6] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices7] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices9] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_readonly_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_non_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_non_contiguous <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_multidimensional <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_formats <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 776s protocol/tests/test_serialize.py::test_dumps_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 776s protocol/tests/test_serialize.py::test_serialize_bytestrings <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 776s protocol/tests/test_serialize.py::test_serialize_empty_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 776s protocol/tests/test_serialize.py::test_serialize_arrays[b] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 776s protocol/tests/test_serialize.py::test_serialize_arrays[B] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 776s protocol/tests/test_serialize.py::test_serialize_arrays[h] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 776s protocol/tests/test_serialize.py::test_serialize_arrays[H] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 776s protocol/tests/test_serialize.py::test_serialize_arrays[i] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 776s protocol/tests/test_serialize.py::test_serialize_arrays[I] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 776s protocol/tests/test_serialize.py::test_serialize_arrays[l] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 776s protocol/tests/test_serialize.py::test_serialize_arrays[L] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 776s protocol/tests/test_serialize.py::test_serialize_arrays[q] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 776s protocol/tests/test_serialize.py::test_serialize_arrays[Q] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 776s protocol/tests/test_serialize.py::test_serialize_arrays[f] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 776s protocol/tests/test_serialize.py::test_serialize_arrays[d] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 776s protocol/tests/test_serialize.py::test_Serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 776s protocol/tests/test_serialize.py::test_Serialized <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 776s protocol/tests/test_serialize.py::test_nested_deserialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 776s protocol/tests/test_serialize.py::test_serialize_iterate_collection <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 776s protocol/tests/test_serialize.py::test_object_in_graph <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 776s protocol/tests/test_serialize.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 776s protocol/tests/test_serialize.py::test_inter_worker_comms <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 776s protocol/tests/test_serialize.py::test_empty <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 776s protocol/tests/test_serialize.py::test_empty_loads <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 776s protocol/tests/test_serialize.py::test_empty_loads_deep <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 777s protocol/tests/test_serialize.py::test_serialize_bytes[kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_serialize_bytes[kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_read_only <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_writeable <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_serialize_list_compress <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_malicious_exception <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_err_on_bad_deserializer <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_context_specific_serialization <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_context_specific_serialization_class <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_serialize_raises <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_different_compression_families <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_frame_split <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_check_dask_serializable[data0-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_check_dask_serializable[data1-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_check_dask_serializable[data2-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_check_dask_serializable[data3-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_check_dask_serializable[data4-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_check_dask_serializable[data5-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_check_dask_serializable[data6-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 778s protocol/tests/test_serialize.py::test_check_dask_serializable[data7-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py XFAIL [ 18%] 778s protocol/tests/test_serialize.py::test_check_dask_serializable[data8-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 778s protocol/tests/test_serialize.py::test_check_dask_serializable[data9-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 778s protocol/tests/test_serialize.py::test_check_dask_serializable[data10-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 778s protocol/tests/test_serialize.py::test_check_dask_serializable[data11-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 778s protocol/tests/test_serialize.py::test_check_dask_serializable[data12-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 778s protocol/tests/test_serialize.py::test_serialize_lists[serializers0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 778s protocol/tests/test_serialize.py::test_serialize_lists[serializers1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 778s protocol/tests/test_serialize.py::test_serialize_lists[serializers2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 778s protocol/tests/test_serialize.py::test_serialize_lists[serializers3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 778s protocol/tests/test_serialize.py::test_deser_memoryview[data_in0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 778s protocol/tests/test_serialize.py::test_deser_memoryview[data_in1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 778s protocol/tests/test_serialize.py::test_ser_memoryview_object <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 778s protocol/tests/test_serialize.py::test_ser_empty_1d_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 778s protocol/tests/test_serialize.py::test_ser_empty_nd_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 780s protocol/tests/test_serialize.py::test_large_pickled_object <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 780s protocol/tests/test_serialize.py::test__is_msgpack_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 780s protocol/tests/test_to_pickle.py::test_ToPickle <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_to_pickle.py PASSED [ 18%] 780s protocol/tests/test_utils.py::test_host_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 18%] 780s protocol/tests/test_utils.py::test_host_array_from_buffers <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 18%] 780s protocol/tests/test_utils.py::test_host_array_from_buffers_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 18%] 780s protocol/tests/test_utils_test.py::test_get_host_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils_test.py PASSED [ 18%] 780s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 781s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 781s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 782s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 782s shuffle/tests/test_buffer.py::test_memory_limit_blocked_exception <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 782s shuffle/tests/test_comm_buffer.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 782s shuffle/tests/test_comm_buffer.py::test_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 782s shuffle/tests/test_comm_buffer.py::test_slow_send <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 782s shuffle/tests/test_comm_buffer.py::test_concurrent_puts <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 782s shuffle/tests/test_comm_buffer.py::test_concurrent_puts_error <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 782s shuffle/tests/test_core.py::test_mean_shard_size <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_core.py PASSED [ 19%] 782s shuffle/tests/test_core.py::test_mean_shard_size_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_core.py PASSED [ 19%] 782s shuffle/tests/test_disk_buffer.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 782s shuffle/tests/test_disk_buffer.py::test_read_before_flush <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 782s shuffle/tests/test_disk_buffer.py::test_many[2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 782s shuffle/tests/test_disk_buffer.py::test_many[100] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 782s shuffle/tests/test_disk_buffer.py::test_many[1000] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 782s shuffle/tests/test_disk_buffer.py::test_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 782s shuffle/tests/test_disk_buffer.py::test_high_pressure_flush_with_exception <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 783s shuffle/tests/test_limiter.py::test_limiter_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 783s shuffle/tests/test_limiter.py::test_unlimited_limiter <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 783s shuffle/tests/test_limiter.py::test_limiter_concurrent_decrease_releases_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 783s shuffle/tests/test_limiter.py::test_limiter_statistics <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 783s shuffle/tests/test_limiter.py::test_limiter_no_limit_no_statistics <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 783s shuffle/tests/test_memory_buffer.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 783s shuffle/tests/test_memory_buffer.py::test_read_before_flush <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 783s shuffle/tests/test_memory_buffer.py::test_many[2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 783s shuffle/tests/test_memory_buffer.py::test_many[100] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 783s shuffle/tests/test_memory_buffer.py::test_many[1000] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 783s shuffle/tests/test_pickle.py::test_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 19%] 783s shuffle/tests/test_pickle.py::test_pickle_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 19%] 783s shuffle/tests/test_pickle.py::test_pickle_zero_copy <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 19%] 783s shuffle/tests/test_read_write_lock.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 783s shuffle/tests/test_read_write_lock.py::test_lock_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 783s shuffle/tests/test_read_write_lock.py::test_concurrent_reads_are_allowed <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 783s shuffle/tests/test_read_write_lock.py::test_read_blocks_write <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 783s shuffle/tests/test_read_write_lock.py::test_write_blocks_read <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 783s shuffle/tests/test_read_write_lock.py::test_write_blocks_write <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 784s shuffle/tests/test_read_write_lock.py::test_write_preferred_over_read <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 784s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 19%] 784s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 19%] 784s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 784s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 784s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 784s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 784s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 784s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 784s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 784s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 784s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-None] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 785s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 785s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 785s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-None] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 785s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 785s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 785s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-None] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 786s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_independent_partitions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 786s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_overlapping_partitions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 786s shuffle/tests/test_rechunk.py::test_rechunk_2d[True] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 786s shuffle/tests/test_rechunk.py::test_rechunk_2d[False] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 787s shuffle/tests/test_rechunk.py::test_rechunk_4d[True] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 787s shuffle/tests/test_rechunk.py::test_rechunk_4d[False] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 787s shuffle/tests/test_rechunk.py::test_rechunk_expand <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 787s shuffle/tests/test_rechunk.py::test_rechunk_expand2 <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 794s shuffle/tests/test_rechunk.py::test_rechunk_method <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 794s shuffle/tests/test_rechunk.py::test_rechunk_blockshape <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 794s shuffle/tests/test_rechunk.py::test_dtype <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 794s shuffle/tests/test_rechunk.py::test_rechunk_with_dict <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 795s shuffle/tests/test_rechunk.py::test_rechunk_with_empty_input <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 795s shuffle/tests/test_rechunk.py::test_rechunk_with_null_dimensions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 795s shuffle/tests/test_rechunk.py::test_rechunk_with_integer <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 795s shuffle/tests/test_rechunk.py::test_rechunk_0d <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 795s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 795s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 795s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 795s shuffle/tests/test_rechunk.py::test_rechunk_empty <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 795s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 795s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array_II <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 795s shuffle/tests/test_rechunk.py::test_rechunk_same <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 795s shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 795s shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown_floats <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 796s shuffle/tests/test_rechunk.py::test_rechunk_same_partially_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 796s shuffle/tests/test_rechunk.py::test_rechunk_with_zero_placeholders <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 796s shuffle/tests/test_rechunk.py::test_rechunk_minus_one <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 796s shuffle/tests/test_rechunk.py::test_rechunk_warning <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 796s shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_pandas <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 796s shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_array <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 796s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x0-chunks0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 797s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x1-chunks1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 797s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x2-chunks2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 798s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x3-chunks3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 800s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x4-chunks4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 801s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x5-chunks5] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 802s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x6-chunks6] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 802s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x7-chunks7] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 802s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x8-chunks8] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 802s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x9-chunks9] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 802s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x10-chunks10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 802s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x11-chunks11] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 803s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x0-chunks0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 803s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x1-chunks1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 804s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x2-chunks2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 806s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x3-chunks3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 809s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x4-chunks4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 812s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x5-chunks5] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 812s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x6-chunks6] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 813s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x7-chunks7] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 813s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x8-chunks8] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 813s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x9-chunks9] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 813s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x10-chunks10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 814s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x11-chunks11] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 814s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 814s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 814s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 814s shuffle/tests/test_rechunk.py::test_rechunk_unknown_raises <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 814s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 815s shuffle/tests/test_rechunk.py::test_rechunk_empty_chunks <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 815s shuffle/tests/test_rechunk.py::test_rechunk_avoid_needless_chunking <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 815s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-1-10-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 815s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-50-10-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 815s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-100-10-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 815s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-7-10-expected3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 815s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-chunks4-5-expected4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 815s shuffle/tests/test_rechunk.py::test_rechunk_auto_2d <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 815s shuffle/tests/test_rechunk.py::test_rechunk_auto_3d <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 815s shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[100] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 816s shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[1000] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 816s shuffle/tests/test_rechunk.py::test_rechunk_down <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 816s shuffle/tests/test_rechunk.py::test_rechunk_zero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 816s shuffle/tests/test_rechunk.py::test_rechunk_bad_keys <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 816s shuffle/tests/test_rechunk.py::test_rechunk_with_zero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 816s shuffle/tests/test_rechunk.py::test_split_axes_1 <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 816s shuffle/tests/test_rechunk.py::test_split_axes_2 <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 816s shuffle/tests/test_rechunk.py::test_split_axes_nan <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 816s shuffle/tests/test_rechunk.py::test_split_axes_nan_single <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 816s shuffle/tests/test_rechunk.py::test_split_axes_nan_long <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 816s shuffle/tests/test_rechunk.py::test_split_axes_with_nonzero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 816s shuffle/tests/test_rechunk.py::test_split_axes_with_zero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 816s shuffle/tests/test_rechunk.py::test_preserve_writeable_flag <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 817s shuffle/tests/test_rechunk.py::test_rechunk_in_memory_shards_dont_share_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 817s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 817s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 817s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[41] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 817s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[50] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 817s shuffle/tests/test_rechunk.py::test_partial_rechunk_homogeneous_distribution <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py SKIPPED [ 23%] 817s shuffle/tests/test_rechunk.py::test_partial_rechunk_taskgroups <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 817s shuffle/tests/test_shuffle_plugins.py::test_installation_on_worker <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle_plugins.py PASSED [ 23%] 817s shuffle/tests/test_shuffle_plugins.py::test_installation_on_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle_plugins.py PASSED [ 23%] 817s tests/test_active_memory_manager.py::test_no_policies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 818s tests/test_active_memory_manager.py::test_drop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 818s tests/test_active_memory_manager.py::test_start_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 819s tests/test_active_memory_manager.py::test_auto_start <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 819s tests/test_active_memory_manager.py::test_add_policy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 819s tests/test_active_memory_manager.py::test_multi_start <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 819s tests/test_active_memory_manager.py::test_not_registered <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 821s tests/test_active_memory_manager.py::test_client_proxy_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 821s tests/test_active_memory_manager.py::test_client_proxy_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 821s tests/test_active_memory_manager.py::test_drop_not_in_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 822s tests/test_active_memory_manager.py::test_drop_with_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 822s tests/test_active_memory_manager.py::test_double_drop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 822s tests/test_active_memory_manager.py::test_double_drop_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 822s tests/test_active_memory_manager.py::test_drop_from_worker_with_least_free_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 822s tests/test_active_memory_manager.py::test_drop_with_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 823s tests/test_active_memory_manager.py::test_drop_with_empty_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 823s tests/test_active_memory_manager.py::test_drop_from_candidates_without_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 823s tests/test_active_memory_manager.py::test_drop_with_bad_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 824s tests/test_active_memory_manager.py::test_drop_prefers_paused_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 824s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 824s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 824s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 824s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 824s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_5 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 825s tests/test_active_memory_manager.py::test_replicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 825s tests/test_active_memory_manager.py::test_replicate_not_in_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 825s tests/test_active_memory_manager.py::test_double_replicate_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 825s tests/test_active_memory_manager.py::test_replicate_to_worker_with_most_free_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 825s tests/test_active_memory_manager.py::test_replicate_with_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 825s tests/test_active_memory_manager.py::test_replicate_with_empty_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 826s tests/test_active_memory_manager.py::test_replicate_to_candidates_with_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 826s tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 826s tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 826s tests/test_active_memory_manager.py::test_bad_measure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 826s tests/test_active_memory_manager.py::test_ReduceReplicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 827s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 827s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 828s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 828s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 828s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 829s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 829s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-2-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 829s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 830s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-17-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 830s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[17-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 831s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[18-1-1-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 831s tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 831s tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 831s tests/test_active_memory_manager.py::test_RetireWorker_no_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 831s tests/test_active_memory_manager.py::test_RetireWorker_no_remove <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 831s tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 831s tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 831s tests/test_active_memory_manager.py::test_RetireWorker_all_replicas_are_being_retired <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 831s tests/test_active_memory_manager.py::test_RetireWorker_no_recipients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 832s tests/test_active_memory_manager.py::test_RetireWorker_all_recipients_are_paused <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 832s tests/test_active_memory_manager.py::test_RetireWorker_new_keys_arrive_after_all_keys_moved_away <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 833s tests/test_active_memory_manager.py::test_RetireWorker_faulty_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 833s tests/test_active_memory_manager.py::test_RetireWorker_mass <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 833s tests/test_active_memory_manager.py::test_RetireWorker_incremental <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 833s tests/test_active_memory_manager.py::test_dont_drop_actors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 834s tests/test_active_memory_manager.py::test_dont_replicate_actors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 834s tests/test_active_memory_manager.py::test_RetireWorker_with_actor[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 834s tests/test_active_memory_manager.py::test_RetireWorker_with_actor[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 834s tests/test_active_memory_manager.py::test_RetireWorker_with_actor_proxy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 834s tests/test_active_memory_manager.py::test_noamm_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 25%] 834s tests/test_active_memory_manager.py::test_drop_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 25%] 834s tests/test_active_memory_manager.py::test_ReduceReplicas_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 25%] 834s tests/test_active_memory_manager.py::test_RetireWorker_stress[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 25%] 834s tests/test_active_memory_manager.py::test_RetireWorker_stress[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 25%] 834s tests/test_actor.py::test_client_actions[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 834s tests/test_actor.py::test_client_actions[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 834s tests/test_actor.py::test_worker_actions[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 834s tests/test_actor.py::test_worker_actions[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 835s tests/test_actor.py::test_Actor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 835s tests/test_actor.py::test_linear_access <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py XFAILges rather than 835s rpc) [ 25%] 835s tests/test_actor.py::test_exceptions_create <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 836s tests/test_actor.py::test_exceptions_method <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 836s tests/test_actor.py::test_gc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 836s tests/test_actor.py::test_track_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 836s tests/test_actor.py::test_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 837s tests/test_actor.py::test_future_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 838s tests/test_actor.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 839s tests/test_actor.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 839s tests/test_actor.py::test_failed_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 840s tests/test_actor.py::test_numpy_roundtrip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 840s tests/test_actor.py::test_numpy_roundtrip_getattr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 840s tests/test_actor.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 840s tests/test_actor.py::test_dir <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 840s tests/test_actor.py::test_many_computations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 840s tests/test_actor.py::test_thread_safety <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 840s tests/test_actor.py::test_Actors_create_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 840s tests/test_actor.py::test_load_balance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 840s tests/test_actor.py::test_load_balance_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 841s tests/test_actor.py::test_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 842s tests/test_actor.py::test_compute_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 842s tests/test_actor.py::test_actors_in_profile <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 843s tests/test_actor.py::test_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 843s tests/test_actor.py::test_worker_actor_handle_is_weakref <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 844s tests/test_actor.py::test_worker_actor_handle_is_weakref_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 846s tests/test_actor.py::test_worker_actor_handle_is_weakref_from_compute_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 847s tests/test_actor.py::test_one_thread_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 848s tests/test_actor.py::test_one_thread_deadlock_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 850s tests/test_actor.py::test_one_thread_deadlock_sync_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 850s tests/test_actor.py::test_async_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 851s tests/test_actor.py::test_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 851s tests/test_actor.py::test_exception_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 853s tests/test_actor.py::test_as_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 853s tests/test_actor.py::test_actor_future_awaitable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 853s tests/test_actor.py::test_actor_future_awaitable_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 853s tests/test_actor.py::test_serialize_with_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 853s tests/test_actor.py::test_worker_client_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 853s tests/test_actor.py::test_worker_client_separate_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 853s tests/test_actor.py::test_get_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 854s tests/test_as_completed.py::test_as_completed_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 26%] 855s tests/test_as_completed.py::test_as_completed_timeout_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 26%] 857s tests/test_as_completed.py::test_as_completed_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 26%] 858s tests/test_as_completed.py::test_as_completed_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 26%] 859s tests/test_as_completed.py::test_as_completed_with_non_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 861s tests/test_as_completed.py::test_as_completed_add <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 862s tests/test_as_completed.py::test_as_completed_update <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 864s tests/test_as_completed.py::test_as_completed_repeats <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 865s tests/test_as_completed.py::test_as_completed_is_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 867s tests/test_as_completed.py::test_as_completed_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 868s tests/test_as_completed.py::test_as_completed_cancel_last <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 868s tests/test_as_completed.py::test_async_for_py2_equivalent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 868s tests/test_as_completed.py::test_as_completed_error_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 870s tests/test_as_completed.py::test_as_completed_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 871s tests/test_as_completed.py::test_as_completed_with_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 871s tests/test_as_completed.py::test_as_completed_with_results_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 873s tests/test_as_completed.py::test_as_completed_with_results_no_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 873s tests/test_as_completed.py::test_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 873s tests/test_as_completed.py::test_as_completed_with_results_no_raise_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 873s tests/test_as_completed.py::test_clear <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 873s tests/test_asyncio.py::test_rlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 27%] 873s tests/test_asyncio.py::test_rlock_nonreentrant <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 27%] 873s tests/test_asyncio.py::test_rlock_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 27%] 873s tests/test_asyncio.py::test_rlock_release_on_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 27%] 874s tests/test_asyncprocess.py::test_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 875s tests/test_asyncprocess.py::test_exitcode <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 876s tests/test_asyncprocess.py::test_sigint_from_same_process <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 876s tests/test_asyncprocess.py::test_sigterm_from_parent_process <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 876s tests/test_asyncprocess.py::test_terminate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 877s tests/test_asyncprocess.py::test_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 878s tests/test_asyncprocess.py::test_exit_callback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 879s tests/test_asyncprocess.py::test_child_main_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 881s tests/test_asyncprocess.py::test_num_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 881s tests/test_asyncprocess.py::test_terminate_after_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 882s tests/test_asyncprocess.py::test_kill <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 884s tests/test_asyncprocess.py::test_asyncprocess_child_teardown_on_parent_exit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 884s tests/test_batched.py::test_close_not_started <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 28%] 884s tests/test_batched.py::test_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py SKIPPED [ 28%] 884s tests/test_batched.py::test_large_traffic_jam <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py SKIPPED [ 28%] 884s tests/test_cancelled_state.py::test_abort_execution_release <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 884s tests/test_cancelled_state.py::test_abort_execution_reschedule <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 884s tests/test_cancelled_state.py::test_abort_execution_add_as_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 884s tests/test_cancelled_state.py::test_abort_execution_to_fetch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 884s tests/test_cancelled_state.py::test_worker_stream_died_during_comm <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 884s tests/test_cancelled_state.py::test_flight_to_executing_via_cancelled_resumed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 884s tests/test_cancelled_state.py::test_executing_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 884s tests/test_cancelled_state.py::test_flight_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 885s tests/test_cancelled_state.py::test_in_flight_lost_after_resumed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 885s tests/test_cancelled_state.py::test_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 885s tests/test_cancelled_state.py::test_cancelled_error_with_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 885s tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 885s tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies_workerstate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 885s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 885s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 886s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 886s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 886s tests/test_cancelled_state.py::test_cancelled_handle_compute[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 886s tests/test_cancelled_state.py::test_cancelled_handle_compute[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 887s tests/test_cancelled_state.py::test_cancelled_task_error_rejected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 887s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[False-resumed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 887s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[False-cancelled] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 888s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-resumed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 888s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-cancelled] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 888s tests/test_cancelled_state.py::test_workerstate_executing_to_executing[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 888s tests/test_cancelled_state.py::test_workerstate_executing_to_executing[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 888s tests/test_cancelled_state.py::test_workerstate_flight_to_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 888s tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 888s tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 888s tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 888s tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 888s tests/test_cancelled_state.py::test_workerstate_flight_skips_executing_on_success <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 888s tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 888s tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 888s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 888s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 888s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 888s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 888s tests/test_cancelled_state.py::test_workerstate_resumed_waiting_to_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 889s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 889s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 889s tests/test_cancelled_state.py::test_workerstate_remove_replica_of_cancelled_task_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 894s tests/test_chaos.py::test_KillWorker[sys.exit] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 30%] 895s tests/test_chaos.py::test_KillWorker[graceful] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 30%] 899s tests/test_chaos.py::test_KillWorker[segfault] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 30%] 899s tests/test_client.py::test_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 899s tests/test_client.py::test_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 899s tests/test_client.py::test_map_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 899s tests/test_client.py::test_map_keynames <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 899s tests/test_client.py::test_map_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 900s tests/test_client.py::test_map_batch_size <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 900s tests/test_client.py::test_custom_key_with_batches <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 900s tests/test_client.py::test_compute_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 900s tests/test_client.py::test_compute_retries_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 902s tests/test_client.py::test_retries_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 902s tests/test_client.py::test_persist_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 902s tests/test_client.py::test_persist_retries_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 902s tests/test_client.py::test_retries_dask_array <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 902s tests/test_client.py::test_future_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 902s tests/test_client.py::test_future_tuple_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 902s tests/test_client.py::test_Future_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 904s tests/test_client.py::test_Future_exception_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 904s tests/test_client.py::test_Future_release <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 906s tests/test_client.py::test_Future_release_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 907s tests/test_client.py::test_short_tracebacks[result] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 909s tests/test_client.py::test_short_tracebacks[gather] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 909s tests/test_client.py::test_short_tracebacks_async[await] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 909s tests/test_client.py::test_short_tracebacks_async[result] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 909s tests/test_client.py::test_short_tracebacks_async[gather] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 909s tests/test_client.py::test_map_naming <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 909s tests/test_client.py::test_submit_naming <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 909s tests/test_client.py::test_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 909s tests/test_client.py::test_gc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 911s tests/test_client.py::test_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 913s tests/test_client.py::test_sync_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 913s tests/test_client.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 913s tests/test_client.py::test_gather_mismatched_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 913s tests/test_client.py::test_gather_lost <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 914s tests/test_client.py::test_gather_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 914s tests/test_client.py::test_gather_strict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 915s tests/test_client.py::test_gather_skip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 915s tests/test_client.py::test_limit_concurrent_gathering <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 915s tests/test_client.py::test_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 917s tests/test_client.py::test_get_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 918s tests/test_client.py::test_no_future_references <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 920s tests/test_client.py::test_get_sync_optimize_graph_passes_through <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 920s tests/test_client.py::test_gather_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 920s tests/test_client.py::test_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 920s tests/test_client.py::test_wait_first_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 920s tests/test_client.py::test_wait_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 922s tests/test_client.py::test_wait_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 923s tests/test_client.py::test_wait_informative_error_for_timeouts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 923s tests/test_client.py::test_garbage_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 923s tests/test_client.py::test_garbage_collection_with_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 924s tests/test_client.py::test_recompute_released_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 924s tests/test_client.py::test_long_tasks_dont_trigger_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 31%] 924s tests/test_client.py::test_tokenize_on_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 924s tests/test_client.py::test_restrictions_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 924s tests/test_client.py::test_restrictions_ip_port <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 924s tests/test_client.py::test_restrictions_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 924s tests/test_client.py::test_restrictions_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 924s tests/test_client.py::test_restrictions_get_annotate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 924s tests/test_client.py::test_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 924s tests/test_client.py::test_errors_dont_block <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 925s tests/test_client.py::test_submit_quotes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 925s tests/test_client.py::test_map_quotes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 925s tests/test_client.py::test_two_consecutive_clients_share_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 925s tests/test_client.py::test_submit_then_get_with_Future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 925s tests/test_client.py::test_aliases <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 925s tests/test_client.py::test_aliases_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 925s tests/test_client.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 925s tests/test_client.py::test_scatter_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 926s tests/test_client.py::test_scatter_non_list <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 926s tests/test_client.py::test_scatter_tokenize_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 926s tests/test_client.py::test_scatter_singletons <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 926s tests/test_client.py::test_scatter_typename <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 926s tests/test_client.py::test_scatter_hash <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 926s tests/test_client.py::test_scatter_hash_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 926s tests/test_client.py::test_get_releases_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 928s tests/test_client.py::test_current <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 929s tests/test_client.py::test_current_nested <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 929s tests/test_client.py::test_current_nested_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 929s tests/test_client.py::test_current_concurrent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 929s tests/test_client.py::test_context_manager_used_from_different_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 931s tests/test_client.py::test_context_manager_used_from_different_threads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 932s tests/test_client.py::test_global_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 932s tests/test_client.py::test_exception_on_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 932s tests/test_client.py::test_get_task_prefix_states <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 932s tests/test_client.py::test_get_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 932s tests/test_client.py::test_nbytes_determines_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 932s tests/test_client.py::test_if_intermediates_clear_on_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 933s tests/test_client.py::test_pragmatic_move_small_data_to_large_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 933s tests/test_client.py::test_get_with_non_list_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 933s tests/test_client.py::test_get_with_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 934s tests/test_client.py::test_get_with_error_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 934s tests/test_client.py::test_directed_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 934s tests/test_client.py::test_scatter_direct <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 935s tests/test_client.py::test_scatter_direct_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 935s tests/test_client.py::test_scatter_direct_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 935s tests/test_client.py::test_scatter_direct_broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 935s tests/test_client.py::test_scatter_direct_balanced <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 935s tests/test_client.py::test_scatter_direct_broadcast_target <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 935s tests/test_client.py::test_scatter_direct_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 935s tests/test_client.py::test_scatter_direct_spread_evenly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 937s tests/test_client.py::test_scatter_gather_sync[True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 938s tests/test_client.py::test_scatter_gather_sync[True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 940s tests/test_client.py::test_scatter_gather_sync[False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 941s tests/test_client.py::test_scatter_gather_sync[False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 941s tests/test_client.py::test_gather_direct <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 941s tests/test_client.py::test_many_submits_spread_evenly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 941s tests/test_client.py::test_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 941s tests/test_client.py::test_get_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 942s tests/test_client.py::test_gather_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 943s tests/test_client.py::test_traceback_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 943s tests/test_client.py::test_upload_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 943s tests/test_client.py::test_upload_file_refresh_delayed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 943s tests/test_client.py::test_upload_file_no_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 944s tests/test_client.py::test_upload_file_zip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py FAILED [ 33%] 944s tests/test_client.py::test_upload_file_egg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 33%] 944s tests/test_client.py::test_upload_large_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 946s tests/test_client.py::test_upload_file_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 946s tests/test_client.py::test_upload_file_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 947s tests/test_client.py::test_upload_file_exception_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 947s tests/test_client.py::test_upload_file_load <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 947s tests/test_client.py::test_upload_file_new_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 947s tests/test_client.py::test_multiple_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 33%] 947s tests/test_client.py::test_async_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 948s tests/test_client.py::test_async_compute_with_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 949s tests/test_client.py::test_sync_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 949s tests/test_client.py::test_remote_scatter_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 949s tests/test_client.py::test_remote_submit_on_Future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 951s tests/test_client.py::test_start_is_idempotent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 951s tests/test_client.py::test_client_with_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 951s tests/test_client.py::test_allow_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 951s tests/test_client.py::test_bad_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 951s tests/test_client.py::test_informative_error_on_cluster_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 951s tests/test_client.py::test_long_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 952s tests/test_client.py::test_map_on_futures_with_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 952s tests/test_client.py::test_badly_serialized_input_stderr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 34%] 953s tests/test_client.py::test_repr[str] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 954s tests/test_client.py::test_repr[repr] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 956s tests/test_client.py::test_repr[func2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 956s tests/test_client.py::test_repr_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 956s tests/test_client.py::test_repr_no_memory_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 956s tests/test_client.py::test_forget_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 956s tests/test_client.py::test_forget_complex <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 957s tests/test_client.py::test_forget_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 957s tests/test_client.py::test_forget_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 958s tests/test_client.py::test_repr_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 958s tests/test_client.py::test_multi_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 959s tests/test_client.py::test_cleanup_after_broken_client_connection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 960s tests/test_client.py::test_multi_garbage_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 960s tests/test_client.py::test__broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 960s tests/test_client.py::test__broadcast_integer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 960s tests/test_client.py::test__broadcast_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 960s tests/test_client.py::test_proxy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 960s tests/test_client.py::test_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 960s tests/test_client.py::test_cancel_tuple_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 960s tests/test_client.py::test_cancel_multi_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 961s tests/test_client.py::test_cancel_before_known_to_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 961s tests/test_client.py::test_cancel_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 962s tests/test_client.py::test_cancel_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 962s tests/test_client.py::test_future_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 962s tests/test_client.py::test_traceback_clean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 962s tests/test_client.py::test_map_differnet_lengths <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 964s tests/test_client.py::test_Future_exception_sync_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 964s tests/test_client.py::test_async_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 964s tests/test_client.py::test__persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 965s tests/test_client.py::test_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 966s tests/test_client.py::test_long_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 966s tests/test_client.py::test_wait_on_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 966s tests/test_client.py::test_futures_of_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 966s tests/test_client.py::test_futures_of_class <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 966s tests/test_client.py::test_futures_of_cancelled_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 966s tests/test_client.py::test_dont_delete_recomputed_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 35%] 966s tests/test_client.py::test_balance_tasks_by_stacks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 35%] 966s tests/test_client.py::test_run <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 966s tests/test_client.py::test_run_handles_picklable_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 968s tests/test_client.py::test_run_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 968s tests/test_client.py::test_run_coroutine <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 969s tests/test_client.py::test_run_coroutine_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 969s tests/test_client.py::test_run_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 970s tests/test_client.py::test_run_rpc_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 972s tests/test_client.py::test_diagnostic_ui <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 973s tests/test_client.py::test_diagnostic_nbytes_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 973s tests/test_client.py::test_diagnostic_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 973s tests/test_client.py::test_worker_aliases <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 975s tests/test_client.py::test_persist_get_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 976s tests/test_client.py::test_persist_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 977s tests/test_client.py::test_client_num_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 977s tests/test_client.py::test_startup_close_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 979s tests/test_client.py::test_startup_close_startup_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 979s tests/test_client.py::test_badly_serialized_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 979s tests/test_client.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 979s tests/test_client.py::test_rebalance_workers_and_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 980s tests/test_client.py::test_rebalance_unprepared <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 980s tests/test_client.py::test_rebalance_raises_on_explicit_missing_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 980s tests/test_client.py::test_receive_lost_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 980s tests/test_client.py::test_unrunnable_task_runs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 982s tests/test_client.py::test_add_worker_after_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 982s tests/test_client.py::test_workers_register_indirect_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 982s tests/test_client.py::test_submit_on_cancelled_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 982s tests/test_client.py::test_replicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 982s tests/test_client.py::test_replicate_tuple_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 983s tests/test_client.py::test_replicate_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 983s tests/test_client.py::test_replicate_tree_branching <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 983s tests/test_client.py::test_client_replicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 983s tests/test_client.py::test_client_replicate_host <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 985s tests/test_client.py::test_client_replicate_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 985s tests/test_client.py::test_task_load_adapts_quickly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 985s tests/test_client.py::test_even_load_after_fast_functions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 985s tests/test_client.py::test_even_load_on_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 985s tests/test_client.py::test_contiguous_load <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 36%] 986s tests/test_client.py::test_balanced_with_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 986s tests/test_client.py::test_balanced_with_submit_and_resident_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 986s tests/test_client.py::test_scheduler_saturates_cores <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 987s tests/test_client.py::test_scheduler_saturates_cores_random <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 987s tests/test_client.py::test_cancel_clears_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 989s tests/test_client.py::test_default_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 989s tests/test_client.py::test_get_scheduler_default_client_config_interleaving <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 989s tests/test_client.py::test_ensure_default_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 989s tests/test_client.py::test_set_as_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 989s tests/test_client.py::test_get_foo <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 989s tests/test_client.py::test_get_foo_lost_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 989s tests/test_client.py::test_bad_tasks_fail <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 37%] 991s tests/test_client.py::test_get_processing_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 993s tests/test_client.py::test_close_idempotent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 994s tests/test_client.py::test_get_returns_early <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 994s tests/test_client.py::test_Client_clears_references_after_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 37%] 996s tests/test_client.py::test_get_stops_work_after_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 997s tests/test_client.py::test_as_completed_list <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 999s tests/test_client.py::test_as_completed_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1001s tests/test_client.py::test_as_completed_batches[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1002s tests/test_client.py::test_as_completed_batches[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1004s tests/test_client.py::test_as_completed_next_batch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1004s tests/test_client.py::test_status <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1004s tests/test_client.py::test_persist_optimize_graph <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1005s tests/test_client.py::test_scatter_raises_if_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1005s tests/test_client.py::test_reconnect <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 37%] 1005s tests/test_client.py::test_reconnect_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1006s tests/test_client.py::test_idempotence <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1007s tests/test_client.py::test_scheduler_info <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1009s tests/test_client.py::test_write_scheduler_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1011s tests/test_client.py::test_get_versions_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1011s tests/test_client.py::test_get_versions_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1011s tests/test_client.py::test_get_versions_rpc_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1013s tests/test_client.py::test_threaded_get_within_distributed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1013s tests/test_client.py::test_lose_scattered_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1014s tests/test_client.py::test_partially_lose_scattered_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1014s tests/test_client.py::test_scatter_compute_lose <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1014s tests/test_client.py::test_scatter_compute_store_lose <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1014s tests/test_client.py::test_scatter_compute_store_lose_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1015s tests/test_client.py::test_serialize_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1015s tests/test_client.py::test_serialize_future_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1015s tests/test_client.py::test_temp_default_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1015s tests/test_client.py::test_as_current <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1016s tests/test_client.py::test_as_current_is_thread_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1017s tests/test_client.py::test_as_current_is_task_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1017s tests/test_client.py::test_persist_workers_annotate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1017s tests/test_client.py::test_persist_workers_annotate2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1017s tests/test_client.py::test_persist_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1017s tests/test_client.py::test_compute_workers_annotate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1017s tests/test_client.py::test_compute_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1017s tests/test_client.py::test_compute_nested_containers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1017s tests/test_client.py::test_scatter_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1018s tests/test_client.py::test_retire_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1018s tests/test_client.py::test_retire_many_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1018s tests/test_client.py::test_weight_occupancy_against_data_movement <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1018s tests/test_client.py::test_distribute_tasks_by_nthreads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1019s tests/test_client.py::test_add_done_callback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1019s tests/test_client.py::test_normalize_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1019s tests/test_client.py::test_normalize_collection_dask_array <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1019s tests/test_client.py::test_normalize_collection_with_released_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 38%] 1019s tests/test_client.py::test_auto_normalize_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 38%] 1021s tests/test_client.py::test_auto_normalize_collection_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 38%] 1021s tests/test_client.py::test_interleave_computations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1021s tests/test_client.py::test_interleave_computations_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 38%] 1021s tests/test_client.py::test_scatter_dict_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1021s tests/test_client.py::test_client_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 38%] 1022s tests/test_client.py::test_submit_list_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1022s tests/test_client.py::test_map_list_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1022s tests/test_client.py::test_recreate_error_delayed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1022s tests/test_client.py::test_recreate_error_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1022s tests/test_client.py::test_recreate_error_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1022s tests/test_client.py::test_recreate_error_array <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 38%] 1024s tests/test_client.py::test_recreate_error_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1025s tests/test_client.py::test_recreate_error_not_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1025s tests/test_client.py::test_recreate_task_delayed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1026s tests/test_client.py::test_recreate_task_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1026s tests/test_client.py::test_recreate_task_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1026s tests/test_client.py::test_recreate_task_array <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1027s tests/test_client.py::test_recreate_task_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1028s tests/test_client.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1028s tests/test_client.py::test_restart_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1028s tests/test_client.py::test_restart_workers_no_nanny_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1028s tests/test_client.py::test_restart_workers_kill_timeout[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1028s tests/test_client.py::test_restart_workers_kill_timeout[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1028s tests/test_client.py::test_restart_workers_restart_timeout[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1028s tests/test_client.py::test_restart_workers_restart_timeout[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1028s tests/test_client.py::test_restart_workers_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1028s tests/test_client.py::test_restart_workers_by_name[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1028s tests/test_client.py::test_restart_workers_by_name[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1028s tests/test_client.py::test_robust_unserializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1028s tests/test_client.py::test_robust_undeserializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1028s tests/test_client.py::test_robust_undeserializable_function <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1028s tests/test_client.py::test_fire_and_forget <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1028s tests/test_client.py::test_fire_and_forget_err <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1029s tests/test_client.py::test_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1031s tests/test_client.py::test_threadsafe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1031s tests/test_client.py::test_threadsafe_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1031s tests/test_client.py::test_threadsafe_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1031s tests/test_client.py::test_identity <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1031s tests/test_client.py::test_get_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1031s tests/test_client.py::test_get_client_no_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1031s tests/test_client.py::test_serialize_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1031s tests/test_client.py::test_secede_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1031s tests/test_client.py::test_secede_balances <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1032s tests/test_client.py::test_long_running_not_in_occupancy[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1032s tests/test_client.py::test_long_running_not_in_occupancy[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1032s tests/test_client.py::test_long_running_removal_clean[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1032s tests/test_client.py::test_long_running_removal_clean[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1032s tests/test_client.py::test_sub_submit_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1034s tests/test_client.py::test_get_client_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1034s tests/test_client.py::test_serialize_collections_of_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1036s tests/test_client.py::test_serialize_collections_of_futures_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1038s tests/test_client.py::test_dynamic_workloads_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1038s tests/test_client.py::test_dynamic_workloads_sync_random <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 40%] 1038s tests/test_client.py::test_bytes_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1038s tests/test_client.py::test_unicode_ascii_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1039s tests/test_client.py::test_unicode_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1040s tests/test_client.py::test_use_synchronous_client_in_async_context <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1042s tests/test_client.py::test_quiet_quit_when_cluster_leaves <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1042s tests/test_client.py::test_call_stack_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1043s tests/test_client.py::test_call_stack_all <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1045s tests/test_client.py::test_call_stack_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1046s tests/test_client.py::test_call_stack_collections_all <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1047s tests/test_client.py::test_profile <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1048s tests/test_client.py::test_profile_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1049s tests/test_client.py::test_profile_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1049s tests/test_client.py::test_client_with_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1049s tests/test_client.py::test_future_defaults_to_default_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1049s tests/test_client.py::test_future_auto_inform <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1049s tests/test_client.py::test_client_async_before_loop_starts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1049s tests/test_client.py::test_nested_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 40%] 1049s tests/test_client.py::test_task_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1051s tests/test_client.py::test_logs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1052s tests/test_client.py::test_logs_from_worker_submodules <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1052s tests/test_client.py::test_avoid_delayed_finalize <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1052s tests/test_client.py::test_config_scheduler_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1053s tests/test_client.py::test_warn_when_submitting_large_values <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1053s tests/test_client.py::test_warn_when_submitting_large_values_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1053s tests/test_client.py::test_unhashable_function <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1053s tests/test_client.py::test_client_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1055s tests/test_client.py::test_client_doesnt_close_given_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1055s tests/test_client.py::test_quiet_scheduler_loss <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 41%] 1056s tests/test_client.py::test_dashboard_link <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1056s tests/test_client.py::test_client_timeout_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1056s tests/test_client.py::test_turn_off_pickle[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1056s tests/test_client.py::test_turn_off_pickle[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1057s tests/test_client.py::test_de_serialization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1057s tests/test_client.py::test_de_serialization_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1057s tests/test_client.py::test_client_repr_closed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1057s tests/test_client.py::test_client_repr_closed_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 41%] 1057s tests/test_client.py::test_nested_prioritization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 41%] 1057s tests/test_client.py::test_scatter_error_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1058s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1058s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1058s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1059s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1059s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1059s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1060s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1060s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1061s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1061s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1061s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1062s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1062s tests/test_client.py::test_no_threads_lingering <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 41%] 1062s tests/test_client.py::test_direct_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1063s tests/test_client.py::test_direct_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1063s tests/test_client.py::test_mixing_clients_same_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1064s tests/test_client.py::test_tuple_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1064s tests/test_client.py::test_multiple_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1066s tests/test_client.py::test_map_large_kwargs_in_graph <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1066s tests/test_client.py::test_retry <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1066s tests/test_client.py::test_retry_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1066s tests/test_client.py::test_released_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1066s tests/test_client.py::test_profile_bokeh <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 1067s tests/test_client.py::test_get_mix_futures_and_SubgraphCallable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1067s tests/test_client.py::test_get_mix_futures_and_SubgraphCallable_dask_dataframe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1068s tests/test_client.py::test_direct_to_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1068s tests/test_client.py::test_instances <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1069s tests/test_client.py::test_wait_for_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1070s tests/test_client.py::test_config_inherited_by_subprocess <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1070s tests/test_client.py::test_futures_of_sorted <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1072s tests/test_client.py::test_profile_server <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1074s tests/test_client.py::test_profile_server_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1074s tests/test_client.py::test_await_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1074s tests/test_client.py::test_as_completed_async_for <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1074s tests/test_client.py::test_as_completed_async_for_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1075s tests/test_client.py::test_as_completed_async_for_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1076s tests/test_client.py::test_client_sync_with_async_def <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1076s tests/test_client.py::test_dont_hold_on_to_large_messages <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 1076s tests/test_client.py::test_run_on_scheduler_async_def <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1076s tests/test_client.py::test_run_on_scheduler_async_def_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1076s tests/test_client.py::test_performance_report[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 1076s tests/test_client.py::test_performance_report[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 1076s tests/test_client.py::test_client_gather_semaphore_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 1076s tests/test_client.py::test_as_completed_condition_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1076s tests/test_client.py::test_client_connectionpool_semaphore_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 1076s tests/test_client.py::test_mixed_compression <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 1078s tests/test_client.py::test_futures_in_subgraphs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1079s tests/test_client.py::test_get_task_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1079s tests/test_client.py::test_get_task_metadata_multiple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1079s tests/test_client.py::test_register_worker_plugin_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1079s tests/test_client.py::test_log_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1079s tests/test_client.py::test_log_event_multiple_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1079s tests/test_client.py::test_annotations_task_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1079s tests/test_client.py::test_annotations_compute_time[compute] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1079s tests/test_client.py::test_annotations_compute_time[persist] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1080s tests/test_client.py::test_annotations_survive_optimization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XFAIL [ 43%] 1080s tests/test_client.py::test_annotations_priorities <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1080s tests/test_client.py::test_annotations_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1080s tests/test_client.py::test_annotations_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1080s tests/test_client.py::test_annotations_blockwise_unpack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1080s tests/test_client.py::test_annotations_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1080s tests/test_client.py::test_annotations_resources_culled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1081s tests/test_client.py::test_annotations_loose_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1081s tests/test_client.py::test_annotations_submit_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1081s tests/test_client.py::test_annotations_global_vs_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1081s tests/test_client.py::test_workers_collection_restriction <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1081s tests/test_client.py::test_get_client_functions_spawn_clusters <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 1081s tests/test_client.py::test_computation_code_walk_frames <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1081s tests/test_client.py::test_computation_ignore_ipython_frames[2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 1081s tests/test_client.py::test_computation_ignore_ipython_frames[3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 1081s tests/test_client.py::test_computation_store_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1083s tests/test_client.py::test_computation_object_code_dask_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1084s tests/test_client.py::test_computation_object_code_dask_compute_no_frames_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1086s tests/test_client.py::test_computation_object_code_not_available <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 1086s tests/test_client.py::test_computation_object_code_dask_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1086s tests/test_client.py::test_computation_object_code_client_submit_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1086s tests/test_client.py::test_computation_object_code_client_submit_list_comp <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1086s tests/test_client.py::test_computation_object_code_client_submit_dict_comp <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1087s tests/test_client.py::test_computation_object_code_client_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1087s tests/test_client.py::test_computation_object_code_client_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1087s tests/test_client.py::test_upload_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 1087s tests/test_client.py::test_duck_typed_register_plugin_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1087s tests/test_client.py::test_exception_text <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1087s tests/test_client.py::test_async_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1087s tests/test_client.py::test_async_task_with_partial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1087s tests/test_client.py::test_events_subscribe_topic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1088s tests/test_client.py::test_events_subscribe_topic_cancelled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1089s tests/test_client.py::test_events_all_servers_use_same_channel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1089s tests/test_client.py::test_events_unsubscribe_raises_if_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1089s tests/test_client.py::test_log_event_warn <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1091s tests/test_client.py::test_log_event_msgpack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1091s tests/test_client.py::test_log_event_warn_dask_warns <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1092s tests/test_client.py::test_print_remote <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1094s tests/test_client.py::test_print_manual <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1095s tests/test_client.py::test_print_manual_bad_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1097s tests/test_client.py::test_print_non_msgpack_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1097s tests/test_client.py::test_print_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1098s tests/test_client.py::test_forward_logging <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1100s tests/test_client.py::test_dump_cluster_state_write_from_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1101s tests/test_client.py::test_dump_cluster_state_sync[msgpack-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1103s tests/test_client.py::test_dump_cluster_state_sync[msgpack-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1105s tests/test_client.py::test_dump_cluster_state_sync[yaml-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1106s tests/test_client.py::test_dump_cluster_state_sync[yaml-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1107s tests/test_client.py::test_dump_cluster_state_async[msgpack-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1107s tests/test_client.py::test_dump_cluster_state_async[msgpack-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1107s tests/test_client.py::test_dump_cluster_state_async[yaml-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1107s tests/test_client.py::test_dump_cluster_state_async[yaml-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1107s tests/test_client.py::test_dump_cluster_state_json[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1108s tests/test_client.py::test_dump_cluster_state_json[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1108s tests/test_client.py::test_dump_cluster_state_exclude_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1108s tests/test_client.py::test_benchmark_hardware_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1109s tests/test_client.py::test_wait_for_workers_updates_info <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1109s tests/test_client.py::test_quiet_close_process[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 44%] 1109s tests/test_client.py::test_quiet_close_process[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 1109s tests/test_client.py::test_deprecated_loop_properties <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1109s tests/test_client.py::test_fast_close_on_aexit_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1109s tests/test_client.py::test_wait_for_workers_n_workers_value_check[None-ValueError] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1109s tests/test_client.py::test_wait_for_workers_n_workers_value_check[0-ValueError] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1109s tests/test_client.py::test_wait_for_workers_n_workers_value_check[1.0-ValueError] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1109s tests/test_client.py::test_wait_for_workers_n_workers_value_check[1-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1109s tests/test_client.py::test_wait_for_workers_n_workers_value_check[2-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1109s tests/test_client.py::test_unpacks_remotedata_namedtuple[PlainNamedTuple-args0-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1109s tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsNamedTuple-args1-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1109s tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsExNamedTuple-args2-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1110s tests/test_client.py::test_resolves_future_in_namedtuple[PlainNamedTuple-args0-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1110s tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsNamedTuple-args1-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1110s tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsExNamedTuple-args2-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1110s tests/test_client.py::test_resolves_future_in_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1110s tests/test_client.py::test_gather_race_vs_AMM[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1110s tests/test_client.py::test_gather_race_vs_AMM[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1112s tests/test_client_executor.py::test_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1114s tests/test_client_executor.py::test_as_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1116s tests/test_client_executor.py::test_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1117s tests/test_client_executor.py::test_cancellation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1120s tests/test_client_executor.py::test_cancellation_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1122s tests/test_client_executor.py::test_cancellation_as_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1122s tests/test_client_executor.py::test_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py SKIPPED [ 45%] 1124s tests/test_client_executor.py::test_pure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1126s tests/test_client_executor.py::test_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1127s tests/test_client_executor.py::test_unsupported_arguments <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1129s tests/test_client_executor.py::test_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1132s tests/test_client_executor.py::test_shutdown_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1133s tests/test_client_executor.py::test_shutdown_nowait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1133s tests/test_cluster_dump.py::test_tuple_to_list[input0-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 45%] 1133s tests/test_cluster_dump.py::test_tuple_to_list[input1-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 45%] 1133s tests/test_cluster_dump.py::test_tuple_to_list[input2-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 1133s tests/test_cluster_dump.py::test_tuple_to_list[foo-foo] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 1133s tests/test_cluster_dump.py::test_write_state_msgpack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 1133s tests/test_cluster_dump.py::test_write_state_yaml <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 1133s tests/test_cluster_dump.py::test_cluster_dump_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 1134s tests/test_cluster_dump.py::test_cluster_dump_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 1134s tests/test_cluster_dump.py::test_cluster_dump_to_yamls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 1134s tests/test_collections.py::test_lru <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1134s tests/test_collections.py::test_heapset <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1134s tests/test_collections.py::test_heapset_sorted_flag_left <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1134s tests/test_collections.py::test_heapset_sorted_flag_right <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1134s tests/test_collections.py::test_heapset_popright[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1134s tests/test_collections.py::test_heapset_popright[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1134s tests/test_collections.py::test_heapset_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1134s tests/test_collections.py::test_heapset_sort_duplicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1134s tests/test_collections.py::test_sum_mappings <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1134s tests/test_compatibility.py::test_randbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_compatibility.py PASSED [ 46%] 1134s tests/test_compatibility.py::test_randbytes_seed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_compatibility.py PASSED [ 46%] 1134s tests/test_computations.py::test_computations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 1134s tests/test_computations.py::test_computations_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 1134s tests/test_computations.py::test_computations_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 1134s tests/test_computations.py::test_computations_no_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 1135s tests/test_computations.py::test_computations_long_running <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 1135s tests/test_config.py::test_logging_default[config0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 1135s tests/test_config.py::test_logging_default[None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 1135s tests/test_config.py::test_logging_simple_under_distributed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 1136s tests/test_config.py::test_logging_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 1137s tests/test_config.py::test_logging_extended <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 1138s tests/test_config.py::test_default_logging_does_not_override_basic_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 1139s tests/test_config.py::test_basic_config_does_not_override_default_logging <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 1139s tests/test_config.py::test_logging_mutual_exclusive <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 1139s tests/test_config.py::test_logging_file_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 1140s tests/test_config.py::test_schema <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1140s tests/test_config.py::test_schema_is_complete <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1140s tests/test_config.py::test_uvloop_event_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py SKIPPED [ 47%] 1140s tests/test_config.py::test_deprecations_on_set[args0-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1140s tests/test_config.py::test_deprecations_on_set[args1-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1140s tests/test_config.py::test_deprecations_on_set[args2-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1140s tests/test_config.py::test_deprecations_on_env_variables <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1140s tests/test_config.py::test_deprecations_on_yaml[allowed-failures] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1140s tests/test_config.py::test_deprecations_on_yaml[allowed_failures] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1140s tests/test_core.py::test_async_task_group_initialization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1140s tests/test_core.py::test_async_task_group_call_soon_executes_task_in_background <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1141s tests/test_core.py::test_async_task_group_call_later_executes_delayed_task_in_background <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1141s tests/test_core.py::test_async_task_group_close_closes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1141s tests/test_core.py::test_async_task_group_close_does_not_cancel_existing_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1141s tests/test_core.py::test_async_task_group_close_prohibits_new_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1141s tests/test_core.py::test_async_task_group_stop_disallows_shutdown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1141s tests/test_core.py::test_async_task_group_stop_cancels_long_running <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1141s tests/test_core.py::test_rpc_inputs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1141s tests/test_core.py::test_large_packets_tcp <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 1141s tests/test_core.py::test_connect_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1141s tests/test_core.py::test_coerce_to_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1141s tests/test_core.py::test_remove_cancels_connect_attempts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1141s tests/test_core.py::test_remove_cancels_connect_before_task_running <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1141s tests/test_core.py::test_ticks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 1141s tests/test_core.py::test_tick_logging <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 1141s tests/test_core.py::test_thread_id <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1141s tests/test_core.py::test_expects_comm <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1141s tests/test_core.py::test_async_listener_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1141s tests/test_core.py::test_large_payload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 1141s tests/test_counter.py::test_digest[Counter-] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py PASSED [ 47%] 1141s tests/test_counter.py::test_digest[None-] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py SKIPPED [ 47%] 1141s tests/test_counter.py::test_counter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py PASSED [ 47%] 1142s tests/test_dask_collections.py::test_dataframes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1143s tests/test_dask_collections.py::test_dask_array_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1143s tests/test_dask_collections.py::test_bag_groupby_tasks_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1144s tests/test_dask_collections.py::test_bag_groupby_key_hashing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1147s tests/test_dask_collections.py::test_dataframe_set_index_sync[wait] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1149s tests/test_dask_collections.py::test_dataframe_set_index_sync[] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1151s tests/test_dask_collections.py::test_loc_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1154s tests/test_dask_collections.py::test_rolling_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1154s tests/test_dask_collections.py::test_loc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1157s tests/test_dask_collections.py::test_dataframe_groupby_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1157s tests/test_dask_collections.py::test_sparse_arrays <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py SKIPPED [ 48%] 1158s tests/test_dask_collections.py::test_delayed_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1160s tests/test_dask_collections.py::test_tuple_futures_arg[tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1161s tests/test_dask_collections.py::test_tuple_futures_arg[list] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1161s tests/test_deadline.py::test_deadline <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 1161s tests/test_deadline.py::test_infinite_deadline <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 1162s tests/test_deadline.py::test_deadline_progress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 1162s tests/test_deadline.py::test_deadline_expiration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 1162s tests/test_deadline.py::test_deadline_expiration_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 1162s tests/test_diskutils.py::test_workdir_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 1162s tests/test_diskutils.py::test_two_workspaces_in_same_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 1163s tests/test_diskutils.py::test_workspace_process_crash <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 1163s tests/test_diskutils.py::test_workspace_rmtree_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 1163s tests/test_diskutils.py::test_locking_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 1163s tests/test_diskutils.py::test_workspace_concurrency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py SKIPPED [ 48%] 1163s tests/test_diskutils.py::test_unwritable_base_dir <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 1164s tests/test_events.py::test_event_on_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 1164s tests/test_events.py::test_default_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 1164s tests/test_events.py::test_set_not_set <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 1164s tests/test_events.py::test_set_not_set_many_events <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 1164s tests/test_events.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 1166s tests/test_events.py::test_event_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 1166s tests/test_events.py::test_event_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 1166s tests/test_events.py::test_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 1167s tests/test_events.py::test_two_events_on_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 1167s tests/test_events.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 1167s tests/test_failed_workers.py::test_submit_after_failed_worker_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1167s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1167s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1168s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1168s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1168s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1168s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1168s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1169s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1169s tests/test_failed_workers.py::test_submit_after_failed_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1169s tests/test_failed_workers.py::test_gather_after_failed_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1169s tests/test_failed_workers.py::test_gather_then_submit_after_failed_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1172s tests/test_failed_workers.py::test_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1175s tests/test_failed_workers.py::test_restart_cleared <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1179s tests/test_failed_workers.py::test_restart_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1185s tests/test_failed_workers.py::test_worker_doesnt_await_task_completion <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1189s tests/test_failed_workers.py::test_multiple_clients_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1192s tests/test_failed_workers.py::test_restart_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1195s tests/test_failed_workers.py::test_forgotten_futures_dont_clean_up_new_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1195s tests/test_failed_workers.py::test_broken_worker_during_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1198s tests/test_failed_workers.py::test_restart_during_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1198s tests/test_failed_workers.py::test_worker_who_has_clears_after_failed_connection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1199s tests/test_failed_workers.py::test_worker_same_host_replicas_missing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1199s tests/test_failed_workers.py::test_restart_timeout_on_long_running_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1199s tests/test_failed_workers.py::test_worker_time_to_live <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1199s tests/test_failed_workers.py::test_worker_ttl_restarts_worker[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1199s tests/test_failed_workers.py::test_worker_ttl_restarts_worker[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1199s tests/test_failed_workers.py::test_restart_hung_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 50%] 1199s tests/test_failed_workers.py::test_forget_data_not_supposed_to_have <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 1201s tests/test_failed_workers.py::test_failing_worker_with_additional_replicas_on_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 1202s tests/test_imports.py::test_can_import_distributed_in_background_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_imports.py PASSED [ 50%] 1202s tests/test_init.py::test_version <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_init.py PASSED [ 50%] 1202s tests/test_itertools.py::test_ffill <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_itertools.py PASSED [ 50%] 1202s tests/test_jupyter.py::test_jupyter_cli <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_jupyter.py SKIPPED [ 50%] 1204s tests/test_locks.py::test_lock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1204s tests/test_locks.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1204s tests/test_locks.py::test_acquires_with_zero_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1204s tests/test_locks.py::test_acquires_blocking <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1206s tests/test_locks.py::test_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1208s tests/test_locks.py::test_lock_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1208s tests/test_locks.py::test_lock_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1208s tests/test_locks.py::test_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1208s tests/test_locks.py::test_locks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1208s tests/test_metrics.py::test_wall_clock[time] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1208s tests/test_metrics.py::test_wall_clock[monotonic] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1208s tests/test_metrics.py::test_monotonic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py SKIPPED [ 50%] 1208s tests/test_metrics.py::test_meter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1208s tests/test_metrics.py::test_meter_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1208s tests/test_metrics.py::test_meter_floor[kwargs0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1208s tests/test_metrics.py::test_meter_floor[kwargs1-0.1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1208s tests/test_metrics.py::test_meter_floor[kwargs2--1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1208s tests/test_metrics.py::test_context_meter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1208s tests/test_metrics.py::test_context_meter_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1208s tests/test_metrics.py::test_context_meter_nested <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1208s tests/test_metrics.py::test_context_meter_decorator <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1208s tests/test_metrics.py::test_context_meter_nested_floor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1208s tests/test_metrics.py::test_context_meter_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1208s tests/test_metrics.py::test_context_meter_clear_callbacks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1208s tests/test_metrics.py::test_context_meter_clear_callbacks_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1208s tests/test_metrics.py::test_context_meter_allow_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 1208s tests/test_metrics.py::test_delayed_metrics_ledger <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 1208s tests/test_metrics.py::test_context_meter_keyed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 1208s tests/test_metrics.py::test_delayed_metrics_ledger_keyed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 1210s tests/test_multi_locks.py::test_single_lock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 1210s tests/test_multi_locks.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 1210s tests/test_multi_locks.py::test_timeout_wake_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 1211s tests/test_multi_locks.py::test_multiple_locks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 1211s tests/test_multi_locks.py::test_num_locks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 1213s tests/test_nanny.py::test_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1215s tests/test_nanny.py::test_nanny_process_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1216s tests/test_nanny.py::test_run <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1216s tests/test_nanny.py::test_no_hang_when_scheduler_closes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 51%] 1216s tests/test_nanny.py::test_close_on_disconnect <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 51%] 1218s tests/test_nanny.py::test_nanny_worker_class <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1219s tests/test_nanny.py::test_nanny_alt_worker_class <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1219s tests/test_nanny.py::test_nanny_death_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 51%] 1221s tests/test_nanny.py::test_random_seed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1227s tests/test_nanny.py::test_num_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1228s tests/test_nanny.py::test_nanny_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1229s tests/test_nanny.py::test_throttle_outgoing_transfers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1230s tests/test_nanny.py::test_scheduler_address_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1230s tests/test_nanny.py::test_wait_for_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 51%] 1231s tests/test_nanny.py::test_environment_variable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1233s tests/test_nanny.py::test_environment_variable_by_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1234s tests/test_nanny.py::test_environment_variable_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1236s tests/test_nanny.py::test_environment_variable_pre_post_spawn <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1237s tests/test_nanny.py::test_environment_variable_overlay <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1238s tests/test_nanny.py::test_config_param_overlays <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1240s tests/test_nanny.py::test_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1241s tests/test_nanny.py::test_unwriteable_dask_worker_space <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1244s tests/test_nanny.py::test_mp_process_worker_no_daemon <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1246s tests/test_nanny.py::test_mp_pool_worker_no_daemon <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1248s tests/test_nanny.py::test_nanny_closes_cleanly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1248s tests/test_nanny.py::test_lifetime <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 1251s tests/test_nanny.py::test_nanny_closes_cleanly_if_worker_is_terminated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1252s tests/test_nanny.py::test_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1255s tests/test_nanny.py::test_nanny_port_range <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1255s tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[tcp] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 1255s tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[ucx] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 1256s tests/test_nanny.py::test_worker_start_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1257s tests/test_nanny.py::test_failure_during_worker_initialization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1261s tests/test_nanny.py::test_environ_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1262s tests/test_nanny.py::test_no_unnecessary_imports_on_worker[scipy] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1264s tests/test_nanny.py::test_no_unnecessary_imports_on_worker[pandas] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py XFAIL [ 52%] 1264s tests/test_nanny.py::test_repeated_restarts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 1264s tests/test_nanny.py::test_restart_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 1264s tests/test_nanny.py::test_close_joins <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 1267s tests/test_nanny.py::test_scheduler_crash_doesnt_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1267s tests/test_nanny.py::test_malloc_trim_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 1269s tests/test_nanny.py::test_default_client_does_not_propagate_to_subprocess <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1270s tests/test_nanny.py::test_worker_inherits_temp_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1272s tests/test_nanny.py::test_log_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1275s tests/test_nanny.py::test_nanny_plugin_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1277s tests/test_nanny.py::test_nanny_plugin_register_during_start_success[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1279s tests/test_nanny.py::test_nanny_plugin_register_during_start_success[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1279s tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1279s tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1280s tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1281s tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1283s tests/test_preload.py::test_worker_preload_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 52%] 1284s tests/test_preload.py::test_worker_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 52%] 1285s tests/test_preload.py::test_worker_preload_module <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 52%] 1286s tests/test_preload.py::test_worker_preload_click <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 52%] 1286s tests/test_preload.py::test_worker_preload_click_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1286s tests/test_preload.py::test_web_preload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1286s tests/test_preload.py::test_scheduler_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1287s tests/test_preload.py::test_scheduler_startup_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1288s tests/test_preload.py::test_web_preload_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1288s tests/test_preload.py::test_client_preload_text <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py XFAIL [ 53%] 1288s tests/test_preload.py::test_client_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1289s tests/test_preload.py::test_client_preload_click <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py XFAIL [ 53%] 1289s tests/test_preload.py::test_failure_doesnt_crash_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1290s tests/test_preload.py::test_failure_doesnt_crash_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1290s tests/test_preload.py::test_failure_doesnt_crash_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1290s tests/test_preload.py::test_client_preload_config_click <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1290s tests/test_priorities.py::test_submit[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1290s tests/test_priorities.py::test_submit[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1291s tests/test_priorities.py::test_map[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1291s tests/test_priorities.py::test_map[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1291s tests/test_priorities.py::test_compute[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1291s tests/test_priorities.py::test_compute[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1291s tests/test_priorities.py::test_persist[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1291s tests/test_priorities.py::test_persist[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1291s tests/test_priorities.py::test_annotate_compute[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1292s tests/test_priorities.py::test_annotate_compute[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1292s tests/test_priorities.py::test_annotate_persist[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1292s tests/test_priorities.py::test_annotate_persist[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1292s tests/test_priorities.py::test_repeated_persists_same_priority[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1293s tests/test_priorities.py::test_repeated_persists_same_priority[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1293s tests/test_priorities.py::test_last_in_first_out[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1294s tests/test_priorities.py::test_last_in_first_out[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1296s tests/test_profile.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 53%] 1296s tests/test_profile.py::test_basic_low_level <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py SKIPPED [ 53%] 1296s tests/test_profile.py::test_merge <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 53%] 1296s tests/test_profile.py::test_merge_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 53%] 1296s tests/test_profile.py::test_call_stack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1296s tests/test_profile.py::test_identifier <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1296s tests/test_profile.py::test_watch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_watch_requires_lock_to_run <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_info_frame_f_lineno[-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_info_frame_f_lineno[0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_info_frame_f_lineno[1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_info_frame_f_lineno[11-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_info_frame_f_lineno[12-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_info_frame_f_lineno[21-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_info_frame_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 54%] 1297s tests/test_profile.py::test_info_frame_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 54%] 1297s tests/test_profile.py::test_info_frame_f_lineno[24-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_info_frame_f_lineno[25-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_info_frame_f_lineno[26-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_info_frame_f_lineno[27-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_info_frame_f_lineno[100-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_call_stack_f_lineno[-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_call_stack_f_lineno[0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_call_stack_f_lineno[1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_call_stack_f_lineno[11-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_call_stack_f_lineno[12-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_call_stack_f_lineno[21-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_call_stack_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 54%] 1297s tests/test_profile.py::test_call_stack_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 54%] 1297s tests/test_profile.py::test_call_stack_f_lineno[24-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_call_stack_f_lineno[25-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_call_stack_f_lineno[26-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_call_stack_f_lineno[27-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_call_stack_f_lineno[100-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_profile.py::test_builtin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1297s tests/test_publish.py::test_publish_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 54%] 1297s tests/test_publish.py::test_publish_non_string_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1297s tests/test_publish.py::test_publish_roundtrip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1297s tests/test_publish.py::test_unpublish <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1299s tests/test_publish.py::test_unpublish_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1299s tests/test_publish.py::test_publish_multiple_datasets <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1301s tests/test_publish.py::test_unpublish_multiple_datasets_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1301s tests/test_publish.py::test_publish_bag <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1303s tests/test_publish.py::test_datasets_setitem <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1304s tests/test_publish.py::test_datasets_getitem <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1306s tests/test_publish.py::test_datasets_getitem_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1307s tests/test_publish.py::test_datasets_delitem <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1309s tests/test_publish.py::test_datasets_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1311s tests/test_publish.py::test_datasets_contains <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1312s tests/test_publish.py::test_datasets_republish <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1314s tests/test_publish.py::test_datasets_iter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1314s tests/test_publish.py::test_datasets_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1314s tests/test_publish.py::test_pickle_safe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1314s tests/test_publish.py::test_deserialize_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1315s tests/test_publish.py::test_publish_submit_ordering <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1315s tests/test_pubsub.py::test_speed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 55%] 1315s tests/test_pubsub.py::test_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 55%] 1315s tests/test_pubsub.py::test_timeouts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 55%] 1315s tests/test_pubsub.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 55%] 1316s tests/test_pubsub.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py XPASS [ 55%] 1316s tests/test_queues.py::test_queue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 1316s tests/test_queues.py::test_queue_with_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 1318s tests/test_queues.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 1318s tests/test_queues.py::test_hold_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 1318s tests/test_queues.py::test_picklability <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 1320s tests/test_queues.py::test_picklability_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 1320s tests/test_queues.py::test_race <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py SKIPPED [ 55%] 1320s tests/test_queues.py::test_same_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 1320s tests/test_queues.py::test_get_many <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 1320s tests/test_queues.py::test_Future_knows_status_immediately <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 1321s tests/test_queues.py::test_erred_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 1321s tests/test_queues.py::test_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 1321s tests/test_queues.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 1322s tests/test_queues.py::test_2220 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 1322s tests/test_queues.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 1322s tests/test_reschedule.py::test_scheduler_reschedule_warns <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1323s tests/test_reschedule.py::test_raise_reschedule[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1323s tests/test_reschedule.py::test_raise_reschedule[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1323s tests/test_reschedule.py::test_cancelled_reschedule[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1323s tests/test_reschedule.py::test_cancelled_reschedule[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1323s tests/test_reschedule.py::test_cancelled_reschedule_worker_state[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1323s tests/test_reschedule.py::test_cancelled_reschedule_worker_state[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1323s tests/test_reschedule.py::test_reschedule_releases[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1323s tests/test_reschedule.py::test_reschedule_releases[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1323s tests/test_reschedule.py::test_reschedule_cancelled[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1323s tests/test_reschedule.py::test_reschedule_cancelled[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1323s tests/test_reschedule.py::test_reschedule_resumed[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1323s tests/test_reschedule.py::test_reschedule_resumed[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1323s tests/test_resources.py::test_resource_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1324s tests/test_resources.py::test_submit_many_non_overlapping <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1325s tests/test_resources.py::test_submit_many_non_overlapping_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1325s tests/test_resources.py::test_move <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1325s tests/test_resources.py::test_dont_work_steal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1325s tests/test_resources.py::test_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1326s tests/test_resources.py::test_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1326s tests/test_resources.py::test_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1326s tests/test_resources.py::test_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1326s tests/test_resources.py::test_persist_multiple_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1326s tests/test_resources.py::test_resources_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1327s tests/test_resources.py::test_minimum_resource <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1327s tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1327s tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1327s tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1327s tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1327s tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1327s tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1327s tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1327s tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1327s tests/test_resources.py::test_constrained_tasks_respect_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1327s tests/test_resources.py::test_task_cancelled_and_readded_with_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1327s tests/test_resources.py::test_balance_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 57%] 1327s tests/test_resources.py::test_set_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1327s tests/test_resources.py::test_persist_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1327s tests/test_resources.py::test_dont_optimize_out <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 57%] 1327s tests/test_resources.py::test_full_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 57%] 1329s tests/test_resources.py::test_collections_get[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py XFAIL [ 57%] 1330s tests/test_resources.py::test_collections_get[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1331s tests/test_resources.py::test_resources_from_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1331s tests/test_resources.py::test_resources_from_python_override_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1331s tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1331s tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1331s tests/test_resources.py::test_cancelled_with_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1331s tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1331s tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1331s tests/test_resources.py::test_cancelled_with_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1331s tests/test_resources.py::test_resumed_with_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1331s tests/test_resources.py::test_resumed_with_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1331s tests/test_resources.py::test_resumed_with_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1331s tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1331s tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1331s tests/test_resources.py::test_resumed_with_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1331s tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1331s tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 1331s tests/test_resources.py::test_resumed_with_different_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 1331s tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 1331s tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 1331s tests/test_resources.py::test_resumed_with_different_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 1331s tests/test_scheduler.py::test_administration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1331s tests/test_scheduler.py::test_respect_data_in_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1331s tests/test_scheduler.py::test_recompute_released_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1331s tests/test_scheduler.py::test_decide_worker_with_many_independent_leaves <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1331s tests/test_scheduler.py::test_decide_worker_with_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1332s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1333s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1334s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1334s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1335s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1335s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1336s tests/test_scheduler.py::test_override_is_rootish <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1336s tests/test_scheduler.py::test_decide_worker_rootish_while_last_worker_is_retiring <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 58%] 1336s tests/test_scheduler.py::test_graph_execution_width <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1338s tests/test_scheduler.py::test_forget_tasks_while_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1338s tests/test_scheduler.py::test_restart_while_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 58%] 1338s tests/test_scheduler.py::test_queued_release_multiple_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1338s tests/test_scheduler.py::test_queued_paused_new_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1338s tests/test_scheduler.py::test_queued_paused_unpaused[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1339s tests/test_scheduler.py::test_queued_paused_unpaused[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1339s tests/test_scheduler.py::test_queued_remove_add_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1339s tests/test_scheduler.py::test_secede_opens_slot <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1339s tests/test_scheduler.py::test_saturation_factor[2.5-expected_task_counts0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1340s tests/test_scheduler.py::test_saturation_factor[2.0-expected_task_counts1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1340s tests/test_scheduler.py::test_saturation_factor[1.1-expected_task_counts2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1340s tests/test_scheduler.py::test_saturation_factor[1.0-expected_task_counts3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1340s tests/test_scheduler.py::test_saturation_factor[0.1-expected_task_counts4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1340s tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts5] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1341s tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts6] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1341s tests/test_scheduler.py::test_bad_saturation_factor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1341s tests/test_scheduler.py::test_move_data_over_break_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1341s tests/test_scheduler.py::test_balance_with_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1341s tests/test_scheduler.py::test_no_valid_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1341s tests/test_scheduler.py::test_no_valid_workers_loose_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1341s tests/test_scheduler.py::test_no_workers[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1342s tests/test_scheduler.py::test_no_workers[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1342s tests/test_scheduler.py::test_retire_workers_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1342s tests/test_scheduler.py::test_retire_workers_lock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1342s tests/test_scheduler.py::test_retire_workers_concurrently <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1342s tests/test_scheduler.py::test_server_listens_to_other_ops <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1343s tests/test_scheduler.py::test_remove_worker_from_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1343s tests/test_scheduler.py::test_remove_worker_by_name_from_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1343s tests/test_scheduler.py::test_clear_events_worker_removal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1343s tests/test_scheduler.py::test_clear_events_client_removal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1343s tests/test_scheduler.py::test_add_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1343s tests/test_scheduler.py::test_blocked_handlers_are_respected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1344s tests/test_scheduler.py::test_scheduler_init_pulls_blocked_handlers_from_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1344s tests/test_scheduler.py::test_feed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1344s tests/test_scheduler.py::test_feed_setup_teardown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1345s tests/test_scheduler.py::test_feed_large_bytestring <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1345s tests/test_scheduler.py::test_delete_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1345s tests/test_scheduler.py::test_delete <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1345s tests/test_scheduler.py::test_dumps_function <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1345s tests/test_scheduler.py::test_ready_remove_worker[1.0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1345s tests/test_scheduler.py::test_ready_remove_worker[inf] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1345s tests/test_scheduler.py::test_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 59%] 1345s tests/test_scheduler.py::test_restart_waits_for_new_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 59%] 1345s tests/test_scheduler.py::test_restart_nanny_timeout_exceeded <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 59%] 1346s tests/test_scheduler.py::test_restart_not_all_workers_return <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1346s tests/test_scheduler.py::test_restart_worker_rejoins_after_timeout_expired <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1346s tests/test_scheduler.py::test_restart_no_wait_for_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1346s tests/test_scheduler.py::test_restart_some_nannies_some_not <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 1346s tests/test_scheduler.py::test_restart_heartbeat_before_closing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 1347s tests/test_scheduler.py::test_broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1407s tests/test_scheduler.py::test_broadcast_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py FAILED [ 60%] 1409s tests/test_scheduler.py::test_broadcast_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1410s tests/test_scheduler.py::test_broadcast_on_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1410s tests/test_scheduler.py::test_broadcast_deprecation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1410s tests/test_scheduler.py::test_worker_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1410s tests/test_scheduler.py::test_coerce_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1410s tests/test_scheduler.py::test_config_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1410s tests/test_scheduler.py::test_config_no_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1410s tests/test_scheduler.py::test_update_graph_culls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1410s tests/test_scheduler.py::test_io_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1410s tests/test_scheduler.py::test_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1411s tests/test_scheduler.py::test_scatter_no_workers[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1411s tests/test_scheduler.py::test_scatter_no_workers[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1412s tests/test_scheduler.py::test_scheduler_sees_memory_limits <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1412s tests/test_scheduler.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1412s tests/test_scheduler.py::test_retire_workers_n <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1412s tests/test_scheduler.py::test_workers_to_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1412s tests/test_scheduler.py::test_workers_to_close_grouped <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1413s tests/test_scheduler.py::test_workers_to_close_never_close_long_running[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1413s tests/test_scheduler.py::test_workers_to_close_never_close_long_running[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1414s tests/test_scheduler.py::test_retire_workers_no_suspicious_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1414s tests/test_scheduler.py::test_file_descriptors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 1414s tests/test_scheduler.py::test_learn_occupancy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 1414s tests/test_scheduler.py::test_learn_occupancy_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 1415s tests/test_scheduler.py::test_balance_many_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1417s tests/test_scheduler.py::test_balance_many_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1419s tests/test_scheduler.py::test_include_communication_in_occupancy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1419s tests/test_scheduler.py::test_nonempty_data_is_rejected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1420s tests/test_scheduler.py::test_worker_arrives_with_data_is_rejected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1422s tests/test_scheduler.py::test_run_on_scheduler_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1422s tests/test_scheduler.py::test_run_on_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1422s tests/test_scheduler.py::test_allow_pickle_false <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1422s tests/test_scheduler.py::test_close_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1422s tests/test_scheduler.py::test_close_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 1423s tests/test_scheduler.py::test_retire_workers_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1423s tests/test_scheduler.py::test_retire_nannies_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 1424s tests/test_scheduler.py::test_fifo_submission <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1425s tests/test_scheduler.py::test_profile_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1426s tests/test_scheduler.py::test_profile_metadata_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1426s tests/test_scheduler.py::test_profile_metadata_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1427s tests/test_scheduler.py::test_statistical_profiling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1427s tests/test_scheduler.py::test_statistical_profiling_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1427s tests/test_scheduler.py::test_cancel_fire_and_forget <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1427s tests/test_scheduler.py::test_log_tasks_during_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 1428s tests/test_scheduler.py::test_get_task_status <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1428s tests/test_scheduler.py::test_deque_handler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1428s tests/test_scheduler.py::test_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1428s tests/test_scheduler.py::test_missing_data_errant_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1428s tests/test_scheduler.py::test_dont_recompute_if_persisted <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1429s tests/test_scheduler.py::test_dont_recompute_if_persisted_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1429s tests/test_scheduler.py::test_dont_recompute_if_persisted_3 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1429s tests/test_scheduler.py::test_dont_recompute_if_persisted_4 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1429s tests/test_scheduler.py::test_dont_forget_released_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1430s tests/test_scheduler.py::test_dont_recompute_if_erred <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1430s tests/test_scheduler.py::test_closing_scheduler_closes_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1430s tests/test_scheduler.py::test_resources_reset_after_cancelled_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1430s tests/test_scheduler.py::test_gh2187 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1430s tests/test_scheduler.py::test_collect_versions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 1430s tests/test_scheduler.py::test_idle_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 1431s tests/test_scheduler.py::test_idle_timeout_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1434s tests/test_scheduler.py::test_no_workers_timeout_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1434s tests/test_scheduler.py::test_no_workers_timeout_without_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 1434s tests/test_scheduler.py::test_no_workers_timeout_bad_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 1435s tests/test_scheduler.py::test_no_workers_timeout_queued <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1435s tests/test_scheduler.py::test_no_workers_timeout_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 1435s tests/test_scheduler.py::test_bandwidth <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1435s tests/test_scheduler.py::test_bandwidth_clear <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 1435s tests/test_scheduler.py::test_workerstate_clean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1435s tests/test_scheduler.py::test_result_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1436s tests/test_scheduler.py::test_close_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1436s tests/test_scheduler.py::test_host_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1436s tests/test_scheduler.py::test_dashboard_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 1436s tests/test_scheduler.py::test_adaptive_target <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1436s tests/test_scheduler.py::test_adaptive_target_empty_cluster[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1437s tests/test_scheduler.py::test_adaptive_target_empty_cluster[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1438s tests/test_scheduler.py::test_retire_names_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1438s tests/test_scheduler.py::test_retire_workers_bad_params <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1438s tests/test_scheduler.py::test_get_task_duration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1439s tests/test_scheduler.py::test_default_task_duration_splits <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1439s tests/test_scheduler.py::test_task_groups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1440s tests/test_scheduler.py::test_task_groups_update_start_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1440s tests/test_scheduler.py::test_task_group_done <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1440s tests/test_scheduler.py::test_task_group_not_done_waiting <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1440s tests/test_scheduler.py::test_task_group_not_done_noworker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1440s tests/test_scheduler.py::test_task_group_not_done_queued <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1440s tests/test_scheduler.py::test_task_group_not_done_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1441s tests/test_scheduler.py::test_task_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1441s tests/test_scheduler.py::test_failing_task_increments_suspicious <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 1441s tests/test_scheduler.py::test_task_group_non_tuple_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1441s tests/test_scheduler.py::test_task_unique_groups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1442s tests/test_scheduler.py::test_task_group_on_fire_and_forget <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1442s tests/test_scheduler.py::test_gather_failing_can_recover <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1443s tests/test_scheduler.py::test_gather_failing_cnn_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1444s tests/test_scheduler.py::test_gather_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1444s tests/test_scheduler.py::test_gather_bad_worker[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1444s tests/test_scheduler.py::test_gather_bad_worker[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1444s tests/test_scheduler.py::test_too_many_groups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1444s tests/test_scheduler.py::test_worker_name_collision <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1444s tests/test_scheduler.py::test_unknown_task_duration_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_unknown_task_duration_config_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_retire_state_change <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_configurable_events_log_length <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_get_worker_monitor_info <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_quiet_cluster_round_robin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_sum <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1445s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memorystate__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 71%] 1446s tests/test_scheduler.py::test_memory_no_zict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_memory_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_infrequent_sysmon <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_close_scheduler__close_workers_Worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1446s tests/test_scheduler.py::test_close_scheduler__close_workers_Nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 71%] 1446s tests/test_scheduler.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 71%] 1447s tests/test_scheduler.py::test_rebalance_managed_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1447s tests/test_scheduler.py::test_rebalance_workers_and_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1447s tests/test_scheduler.py::test_rebalance_missing_data1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1447s tests/test_scheduler.py::test_rebalance_missing_data2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1447s tests/test_scheduler.py::test_rebalance_raises_missing_data3[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1448s tests/test_scheduler.py::test_rebalance_raises_missing_data3[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py XFAIL subject to a race 1448s condition. This test assumes that the data is freed before 1448s the rebalance get_data requests come in but merely deleting 1448s the futures is not sufficient to guarantee this) [ 71%] 1448s tests/test_scheduler.py::test_rebalance_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1448s tests/test_scheduler.py::test_rebalance_no_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1448s tests/test_scheduler.py::test_rebalance_no_recipients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 1448s tests/test_scheduler.py::test_rebalance_skip_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1448s tests/test_scheduler.py::test_rebalance_skip_all_recipients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1448s tests/test_scheduler.py::test_rebalance_sender_below_mean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 1448s tests/test_scheduler.py::test_rebalance_least_recently_inserted_sender_min <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 1448s tests/test_scheduler.py::test_gather_on_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1449s tests/test_scheduler.py::test_gather_on_worker_bad_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1449s tests/test_scheduler.py::test_gather_on_worker_bad_sender <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1449s tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1449s tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1449s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1449s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1450s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1450s tests/test_scheduler.py::test_gather_on_worker_duplicate_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1450s tests/test_scheduler.py::test_rebalance_dead_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1450s tests/test_scheduler.py::test_delete_worker_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1450s tests/test_scheduler.py::test_delete_worker_data_double_delete <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1451s tests/test_scheduler.py::test_delete_worker_data_bad_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1451s tests/test_scheduler.py::test_delete_worker_data_bad_task[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1451s tests/test_scheduler.py::test_delete_worker_data_bad_task[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1451s tests/test_scheduler.py::test_transition_counter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1451s tests/test_scheduler.py::test_transition_counter_max_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 1451s tests/test_scheduler.py::test_transition_counter_max_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1453s tests/test_scheduler.py::test_disable_transition_counter_max <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1454s tests/test_scheduler.py::test_worker_heartbeat_after_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1454s tests/test_scheduler.py::test_set_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1455s tests/test_scheduler.py::test_avoid_paused_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1455s tests/test_scheduler.py::test_Scheduler__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1455s tests/test_scheduler.py::test_TaskState__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1455s tests/test_scheduler.py::test_get_cluster_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1455s tests/test_scheduler.py::test_get_cluster_state_worker_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1456s tests/test_scheduler.py::test_dump_cluster_state[msgpack] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1456s tests/test_scheduler.py::test_dump_cluster_state[yaml] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1456s tests/test_scheduler.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1457s tests/test_scheduler.py::test_ensure_events_dont_include_taskstate_objects <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1457s tests/test_scheduler.py::test_worker_state_unique_regardless_of_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1457s tests/test_scheduler.py::test_scheduler_close_fast_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1460s tests/test_scheduler.py::test_runspec_regression_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1460s tests/test_scheduler.py::test_KilledWorker_informative_message <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1460s tests/test_scheduler.py::test_count_task_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1460s tests/test_scheduler.py::test_transition_waiting_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1461s tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1461s tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1461s tests/test_scheduler.py::test_submit_dependency_of_erred_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1461s tests/test_scheduler.py::test_tell_workers_when_peers_have_left <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1462s tests/test_scheduler.py::test_client_desires_keys_creates_ts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1462s tests/test_scheduler.py::test_scatter_creates_ts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1462s tests/test_scheduler.py::test_refuse_to_schedule_huge_task[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1462s tests/test_scheduler.py::test_refuse_to_schedule_huge_task[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1463s tests/test_scheduler.py::test_html_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1463s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[same] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1463s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[less] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1464s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[more] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1464s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-same] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1464s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-less] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1464s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-more] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1464s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-same] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1465s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-less] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1465s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-more] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1465s tests/test_scheduler.py::test_resubmit_different_task_same_key_many_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1465s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before0-123-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1465s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[123-after1-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1466s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before2-after2-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1466s tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1466s tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1466s tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[10-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1466s tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[30-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1466s tests/test_scheduler.py::test_fan_out_pattern_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1467s tests/test_scheduler.py::test_stimulus_from_erred_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1467s tests/test_security.py::test_defaults <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_constructor_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_attribute_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_from_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_min_max_version_from_config[None-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_min_max_version_from_config[None-1.2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_min_max_version_from_config[None-1.3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_min_max_version_from_config[1.2-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_min_max_version_from_config[1.2-1.2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_min_max_version_from_config[1.2-1.3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_min_max_version_from_config[1.3-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_min_max_version_from_config[1.3-1.2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_min_max_version_from_config[1.3-1.3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_min_max_version_config_errors[min-version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_min_max_version_config_errors[max-version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_invalid_min_version_from_config_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_min_max_version_kwarg_errors[tls_min_version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_min_max_version_kwarg_errors[tls_max_version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_repr_temp_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 74%] 1467s tests/test_security.py::test_repr_local_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_tls_config_for_role <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_connection_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_extra_conn_args_connection_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_listen_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 1467s tests/test_security.py::test_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 74%] 1467s tests/test_security.py::test_extra_conn_args_in_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 75%] 1467s tests/test_semaphore.py::test_semaphore_trivial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1467s tests/test_semaphore.py::test_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1468s tests/test_semaphore.py::test_release_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1468s tests/test_semaphore.py::test_acquires_with_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1470s tests/test_semaphore.py::test_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1470s tests/test_semaphore.py::test_release_semaphore_after_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1471s tests/test_semaphore.py::test_async_ctx <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1473s tests/test_semaphore.py::test_worker_dies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1474s tests/test_semaphore.py::test_access_semaphore_by_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1474s tests/test_semaphore.py::test_close_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1476s tests/test_semaphore.py::test_close_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1476s tests/test_semaphore.py::test_release_once_too_many <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1476s tests/test_semaphore.py::test_release_once_too_many_resilience <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1477s tests/test_semaphore.py::test_retry_acquire <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1477s tests/test_semaphore.py::test_oversubscribing_leases <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1477s tests/test_semaphore.py::test_timeout_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1478s tests/test_semaphore.py::test_getvalue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1478s tests/test_semaphore.py::test_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1478s tests/test_semaphore.py::test_release_retry <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1478s tests/test_semaphore.py::test_release_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1478s tests/test_semaphore.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 1478s tests/test_sizeof.py::test_safe_sizeof[obj0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 75%] 1478s tests/test_sizeof.py::test_safe_sizeof[obj1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 75%] 1478s tests/test_sizeof.py::test_safe_sizeof[obj2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 75%] 1478s tests/test_sizeof.py::test_safe_sizeof_logs_on_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 75%] 1479s tests/test_spans.py::test_spans <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 1479s tests/test_spans.py::test_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 1479s tests/test_spans.py::test_multiple_tags <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 1479s tests/test_spans.py::test_repeat_span <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 1479s tests/test_spans.py::test_default_span <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 1481s tests/test_spans.py::test_no_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 1482s tests/test_spans.py::test_task_groups[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1482s tests/test_spans.py::test_task_groups[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1483s tests/test_spans.py::test_before_first_task_finished <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1483s tests/test_spans.py::test_duplicate_task_group <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1483s tests/test_spans.py::test_mismatched_span[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1483s tests/test_spans.py::test_mismatched_span[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1483s tests/test_spans.py::test_no_tags <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1483s tests/test_spans.py::test_client_desires_keys_creates_ts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1484s tests/test_spans.py::test_client_desires_keys_creates_tg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1484s tests/test_spans.py::test_scatter_creates_ts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1484s tests/test_spans.py::test_scatter_creates_tg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1484s tests/test_spans.py::test_worker_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1485s tests/test_spans.py::test_merge_by_tags <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1485s tests/test_spans.py::test_merge_by_tags_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1485s tests/test_spans.py::test_code <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1486s tests/test_spans.py::test_no_code_by_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1486s tests/test_spans.py::test_merge_all <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1486s tests/test_spans.py::test_merge_nothing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1486s tests/test_spans.py::test_active_cpu_seconds_trivial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1486s tests/test_spans.py::test_active_cpu_seconds_not_done[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1487s tests/test_spans.py::test_active_cpu_seconds_not_done[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1487s tests/test_spans.py::test_active_cpu_seconds_change_nthreads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1488s tests/test_spans.py::test_active_cpu_seconds_merged <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1488s tests/test_spans.py::test_spans_are_visible_from_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1488s tests/test_spans.py::test_span_on_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 1488s tests/test_spans.py::test_collections_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py XPASS [ 76%] 1488s tests/test_spec.py::test_address_default_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spec.py PASSED [ 76%] 1488s tests/test_spec.py::test_child_address_persists <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spec.py PASSED [ 76%] 1488s tests/test_spill.py::test_psize <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 76%] 1488s tests/test_spill.py::test_spillbuffer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 76%] 1488s tests/test_spill.py::test_disk_size_calculation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 76%] 1488s tests/test_spill.py::test_spillbuffer_maxlim <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 76%] 1488s tests/test_spill.py::test_spillbuffer_fail_to_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 1488s tests/test_spill.py::test_spillbuffer_evict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 1488s tests/test_spill.py::test_no_pop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 1488s tests/test_spill.py::test_weakref_cache[60-SupportsWeakRef-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 1488s tests/test_spill.py::test_weakref_cache[60-NoWeakRef-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 1488s tests/test_spill.py::test_weakref_cache[110-SupportsWeakRef-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 1488s tests/test_spill.py::test_weakref_cache[110-NoWeakRef-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 1488s tests/test_spill.py::test_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 1488s tests/test_spill.py::test_compression_settings[zlib-100-500] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 1488s tests/test_spill.py::test_compression_settings[None-20000-20500] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 1488s tests/test_spill.py::test_str_collision <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 1489s tests/test_steal.py::test_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1489s tests/test_steal.py::test_dont_steal_expensive_data_fast_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1490s tests/test_steal.py::test_steal_cheap_data_slow_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1490s tests/test_steal.py::test_steal_expensive_data_slow_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 77%] 1492s tests/test_steal.py::test_worksteal_many_thieves <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1492s tests/test_steal.py::test_stop_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1493s tests/test_steal.py::test_stop_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1495s tests/test_steal.py::test_allow_tasks_stolen_before_first_completes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1495s tests/test_steal.py::test_eventually_steal_unknown_functions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1495s tests/test_steal.py::test_steal_related_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 77%] 1496s tests/test_steal.py::test_dont_steal_fast_tasks_compute_time <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1498s tests/test_steal.py::test_dont_steal_fast_tasks_blocklist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1500s tests/test_steal.py::test_new_worker_steals <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1502s tests/test_steal.py::test_work_steal_allow_other_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1502s tests/test_steal.py::test_dont_steal_worker_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1503s tests/test_steal.py::test_steal_worker_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1503s tests/test_steal.py::test_dont_steal_host_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1503s tests/test_steal.py::test_steal_host_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1504s tests/test_steal.py::test_dont_steal_resource_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1504s tests/test_steal.py::test_steal_resource_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1505s tests/test_steal.py::test_steal_resource_restrictions_asym_diff <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 1506s tests/test_steal.py::test_balance_without_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1506s tests/test_steal.py::test_dont_steal_executing_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1507s tests/test_steal.py::test_dont_steal_executing_tasks_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1508s tests/test_steal.py::test_dont_steal_few_saturated_tasks_many_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1509s tests/test_steal.py::test_steal_when_more_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1509s tests/test_steal.py::test_steal_more_attractive_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1509s tests/test_steal.py::test_balance[don't move unnecessarily] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1510s tests/test_steal.py::test_balance[balance] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1510s tests/test_steal.py::test_balance[balance even if results in even] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1510s tests/test_steal.py::test_balance[don't over balance] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1510s tests/test_steal.py::test_balance[move from larger] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1510s tests/test_steal.py::test_balance[move to smaller] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1511s tests/test_steal.py::test_balance[choose easier first] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1511s tests/test_steal.py::test_balance[spread evenly] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1511s tests/test_steal.py::test_balance[move easier] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1511s tests/test_steal.py::test_balance[be willing to move costly items] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1512s tests/test_steal.py::test_balance[but don't move too many] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1512s tests/test_steal.py::test_balance[no one clearly saturated] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1512s tests/test_steal.py::test_balance[balance multiple saturated workers] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1515s tests/test_steal.py::test_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1516s tests/test_steal.py::test_paused_workers_must_not_steal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1517s tests/test_steal.py::test_dont_steal_already_released <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1517s tests/test_steal.py::test_dont_steal_long_running_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1518s tests/test_steal.py::test_cleanup_repeated_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1519s tests/test_steal.py::test_lose_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1519s tests/test_steal.py::test_parse_stealing_interval[None-100] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1519s tests/test_steal.py::test_parse_stealing_interval[500ms-500] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1519s tests/test_steal.py::test_parse_stealing_interval[2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1525s tests/test_steal.py::test_balance_with_longer_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1526s tests/test_steal.py::test_blocklist_shuffle_split <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1526s tests/test_steal.py::test_steal_concurrent_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1527s tests/test_steal.py::test_steal_reschedule_reset_in_flight_occupancy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 1528s tests/test_steal.py::test_get_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1528s tests/test_steal.py::test_steal_worker_dies_same_ip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1528s tests/test_steal.py::test_reschedule_concurrent_requests_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1528s tests/test_steal.py::test_correct_bad_time_estimate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 79%] 1529s tests/test_steal.py::test_steal_stimulus_id_unique <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1529s tests/test_steal.py::test_steal_worker_state[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1529s tests/test_steal.py::test_steal_worker_state[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1529s tests/test_steal.py::test_steal_very_fast_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 79%] 1529s tests/test_steal.py::test_balance_expensive_tasks[not enough work to steal] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1530s tests/test_steal.py::test_balance_expensive_tasks[enough work to steal] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1530s tests/test_steal.py::test_balance_expensive_tasks[not enough work for increased cost] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1531s tests/test_steal.py::test_balance_uneven_without_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1531s tests/test_steal.py::test_balance_eventually_steals_large_dependency_without_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1531s tests/test_steal.py::test_balance_even_with_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1533s tests/test_steal.py::test_balance_to_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1534s tests/test_steal.py::test_balance_multiple_to_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1536s tests/test_steal.py::test_balance_to_larger_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1538s tests/test_steal.py::test_balance_prefers_busier_with_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1540s tests/test_steal.py::test_trivial_workload_should_not_cause_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1540s tests/test_stories.py::test_scheduler_story_stimulus_success <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 1540s tests/test_stories.py::test_scheduler_story_stimulus_retry <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 1541s tests/test_stories.py::test_client_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 1541s tests/test_stories.py::test_client_story_failed_worker[ignore] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 1541s tests/test_stories.py::test_client_story_failed_worker[raise] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 1541s tests/test_stories.py::test_worker_story_with_deps <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 1542s tests/test_stress.py::test_stress_1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 79%] 1542s tests/test_stress.py::test_stress_gc[slowinc-100] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 79%] 1542s tests/test_stress.py::test_stress_gc[inc-1000] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 79%] 1547s tests/test_stress.py::test_cancel_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 79%] 1552s tests/test_stress.py::test_cancel_stress_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 79%] 1552s tests/test_stress.py::test_stress_creation_and_deletion <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 79%] 1554s tests/test_stress.py::test_stress_scatter_death <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 80%] 1554s tests/test_stress.py::test_stress_steal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 1554s tests/test_stress.py::test_close_connections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 1554s tests/test_stress.py::test_no_delay_during_large_transfer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 1554s tests/test_stress.py::test_chaos_rechunk <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 1554s tests/test_system.py::test_memory_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 1554s tests/test_system.py::test_hard_memory_limit_cgroups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 1554s tests/test_system.py::test_soft_memory_limit_cgroups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 1554s tests/test_system.py::test_hard_memory_limit_cgroups2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 1554s tests/test_system.py::test_soft_memory_limit_cgroups2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 1554s tests/test_system.py::test_softest_memory_limit_cgroups2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 1554s tests/test_system.py::test_rlimit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 1554s tests/test_system_monitor.py::test_SystemMonitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 1554s tests/test_system_monitor.py::test_maxlen_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 1554s tests/test_system_monitor.py::test_count <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 1554s tests/test_system_monitor.py::test_range_query <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 1554s tests/test_system_monitor.py::test_disk_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 1554s tests/test_system_monitor.py::test_host_cpu <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 1554s tests/test_system_monitor.py::test_gil_contention <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py SKIPPED [ 80%] 1554s tests/test_threadpoolexecutor.py::test_tpe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 1555s tests/test_threadpoolexecutor.py::test_shutdown_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 1555s tests/test_threadpoolexecutor.py::test_shutdown_timeout_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 1555s tests/test_threadpoolexecutor.py::test_shutdown_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 1556s tests/test_threadpoolexecutor.py::test_secede_rejoin_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 1556s tests/test_threadpoolexecutor.py::test_secede_rejoin_quiet <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 1556s tests/test_threadpoolexecutor.py::test_rejoin_idempotent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 1556s tests/test_threadpoolexecutor.py::test_thread_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 1617s tests/test_tls_functional.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 80%] 1677s tests/test_tls_functional.py::test_Queue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 80%] 1738s tests/test_tls_functional.py::test_client_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 80%] 1798s tests/test_tls_functional.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 80%] 1859s tests/test_tls_functional.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 80%] 1919s tests/test_tls_functional.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 1980s tests/test_tls_functional.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 2040s tests/test_tls_functional.py::test_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 2101s tests/test_tls_functional.py::test_worker_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 2161s tests/test_tls_functional.py::test_worker_client_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 2222s tests/test_tls_functional.py::test_worker_client_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 2282s tests/test_tls_functional.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 2313s tests/test_tls_functional.py::test_security_dict_input <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 2313s tests/test_utils.py::test_All <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_sync_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_sync_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_sync_closed_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_sync_contextvars <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_is_kernel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py SKIPPED [ 81%] 2313s tests/test_utils.py::test_ensure_ip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_get_ip_interface <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_get_mp_context <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_truncate_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_get_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_maybe_complex <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_read_block <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_seek_delimiter_endline <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_ensure_memoryview[] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_ensure_memoryview[data1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_ensure_memoryview[1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_ensure_memoryview[data3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_ensure_memoryview[data4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_ensure_memoryview[data5] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_ensure_memoryview[data6] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_ensure_memoryview[data7] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_ensure_memoryview[data8] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2313s tests/test_utils.py::test_ensure_memoryview[data9] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_ensure_memoryview[data10] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_ensure_memoryview[data11] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_ensure_memoryview[data12] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_ensure_memoryview[data13] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_ensure_memoryview[data14] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape0-strides0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape1-strides1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape2-strides2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape3-strides3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape4-strides4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_ensure_memoryview_pyarrow_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py SKIPPED [ 82%] 2313s tests/test_utils.py::test_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_open_port <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_set_thread_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_loop_runner <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_two_loop_runners <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_loop_runner_gen <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_loop_runner_exception_in_start <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_loop_runner_exception_in_teardown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_all_quiet_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_warn_on_duration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_logs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_is_valid_xml <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_format_dashboard_link <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_parse_ports <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_run_in_executor_with_context <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_run_in_executor_with_context_preserves_contextvars <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_offload_preserves_contextvars <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_no_default_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_iscoroutinefunction_unhashable_input <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2313s tests/test_utils.py::test_iscoroutinefunction_nested_partial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2313s tests/test_utils.py::test_recursive_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2313s tests/test_utils.py::test_recursive_to_dict_no_nest <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2313s tests/test_utils.py::test_log_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2313s tests/test_utils.py::test_log_errors_unroll_stack[0-test_utils] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2313s tests/test_utils.py::test_log_errors_unroll_stack[1-a.b.c] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2314s tests/test_utils.py::test_load_json_robust_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2314s tests/test_utils.py::test_rate_limiter_filter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2314s tests/test_utils.py::test_tuple_comparable_lt[obj10-obj20-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2314s tests/test_utils.py::test_tuple_comparable_lt[obj11-obj21-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2314s tests/test_utils.py::test_tuple_comparable_lt[1-1-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2314s tests/test_utils.py::test_tuple_comparable_lt[1-2-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2314s tests/test_utils.py::test_tuple_comparable_lt[None-0-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2314s tests/test_utils.py::test_tuple_comparable_lt[None-obj25-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2314s tests/test_utils.py::test_tuple_comparable_eq[obj10-obj20-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2314s tests/test_utils.py::test_tuple_comparable_eq[obj11-obj21-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2314s tests/test_utils.py::test_tuple_comparable_eq[1-1-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2314s tests/test_utils.py::test_tuple_comparable_eq[1-2-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2314s tests/test_utils.py::test_tuple_comparable_eq[None-0-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2314s tests/test_utils.py::test_tuple_comparable_eq[None-obj25-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2314s tests/test_utils.py::test_tuple_comparable_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2314s tests/test_utils_comm.py::test_pack_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2314s tests/test_utils_comm.py::test_subs_multiple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2314s tests/test_utils_comm.py::test_gather_from_workers_missing_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2314s tests/test_utils_comm.py::test_gather_from_workers_permissive <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2314s tests/test_utils_comm.py::test_gather_from_workers_permissive_flaky <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2315s tests/test_utils_comm.py::test_gather_from_workers_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2315s tests/test_utils_comm.py::test_gather_from_workers_serialization_error[pickle] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2315s tests/test_utils_comm.py::test_gather_from_workers_serialization_error[unpickle] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2315s tests/test_utils_comm.py::test_retry_no_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2315s tests/test_utils_comm.py::test_retry0_raises_immediately <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2315s tests/test_utils_comm.py::test_retry_does_retry_and_sleep <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2315s tests/test_utils_comm.py::test_unpack_remotedata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 2315s tests/test_utils_perf.py::test_fractional_timer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_perf.py PASSED [ 84%] 2315s tests/test_utils_perf.py::test_gc_diagnosis_cpu_time <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_perf.py SKIPPED [ 84%] 2316s tests/test_utils_perf.py::test_gc_diagnosis_rss_win <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_perf.py XFAIL [ 84%] 2320s tests/test_utils_test.py::test_bare_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2321s tests/test_utils_test.py::test_gen_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2321s tests/test_utils_test.py::test_gen_cluster_pytest_fixture <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2321s tests/test_utils_test.py::test_gen_cluster_parametrized[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2321s tests/test_utils_test.py::test_gen_cluster_multi_parametrized[a-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2321s tests/test_utils_test.py::test_gen_cluster_multi_parametrized[b-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2321s tests/test_utils_test.py::test_gen_cluster_parametrized_variadic_workers[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2323s tests/test_utils_test.py::test_gen_cluster_set_config_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2323s tests/test_utils_test.py::test_gen_cluster_cleans_up_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 84%] 2323s tests/test_utils_test.py::test_gen_cluster_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2384s tests/test_utils_test.py::test_gen_cluster_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py FAILED [ 84%] 2384s tests/test_utils_test.py::test_gen_cluster_validate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2384s tests/test_utils_test.py::test_gen_cluster_validate_override <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2384s tests/test_utils_test.py::test_gen_test <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAILn) [ 84%] 2384s tests/test_utils_test.py::test_gen_test_legacy_implicit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAIL [ 84%] 2384s tests/test_utils_test.py::test_gen_test_legacy_explicit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAIL [ 84%] 2384s tests/test_utils_test.py::test_gen_test_parametrized[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2384s tests/test_utils_test.py::test_gen_test_double_parametrized[False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2384s tests/test_utils_test.py::test_gen_test_pytest_fixture <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2384s tests/test_utils_test.py::test_gen_test_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2384s tests/test_utils_test.py::test_gen_test_config_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2384s tests/test_utils_test.py::test_new_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2385s tests/test_utils_test.py::test_lingering_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2387s tests/test_utils_test.py::test_lingering_client_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2687s tests/test_utils_test.py::test_tls_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py +++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++ 2687s ~~~~~~~~~~~~~~~~~~~ Stack of test IOLoop_0 (253159731687808) ~~~~~~~~~~~~~~~~~~~ 2687s File "/usr/lib/python3.13/threading.py", line 1012, in _bootstrap 2687s self._bootstrap_inner() 2687s File "/usr/lib/python3.13/threading.py", line 1041, in _bootstrap_inner 2687s self.run() 2687s File "/usr/lib/python3.13/threading.py", line 992, in run 2687s self._target(*self._args, **self._kwargs) 2687s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 92, in _worker 2687s work_item.run() 2687s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 58, in run 2687s result = self.fn(*self.args, **self.kwargs) 2687s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 378, in _run_and_close_tornado 2687s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 2687s File "/usr/lib/python3.13/asyncio/runners.py", line 194, in run 2687s return runner.run(main) 2687s File "/usr/lib/python3.13/asyncio/runners.py", line 118, in run 2687s return self._loop.run_until_complete(task) 2687s File "/usr/lib/python3.13/asyncio/base_events.py", line 707, in run_until_complete 2687s self.run_forever() 2687s File "/usr/lib/python3.13/asyncio/base_events.py", line 678, in run_forever 2687s self._run_once() 2687s File "/usr/lib/python3.13/asyncio/base_events.py", line 1995, in _run_once 2687s event_list = self._selector.select(timeout) 2687s File "/usr/lib/python3.13/selectors.py", line 452, in select 2687s fd_event_list = self._selector.poll(timeout, max_ev) 2687s ~~~~~~~~~~~~~~ Stack of Dask-Callback-Thread_0 (253159922528640) ~~~~~~~~~~~~~~~ 2687s File "/usr/lib/python3.13/threading.py", line 1012, in _bootstrap 2687s self._bootstrap_inner() 2687s File "/usr/lib/python3.13/threading.py", line 1041, in _bootstrap_inner 2687s self.run() 2687s File "/usr/lib/python3.13/threading.py", line 992, in run 2687s self._target(*self._args, **self._kwargs) 2687s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 89, in _worker 2687s work_item = work_queue.get(block=True) 2687s ~~~~~~~~~~~~~~~~~~ Stack of Dask-Offload_0 (253160497148288) ~~~~~~~~~~~~~~~~~~~ 2687s File "/usr/lib/python3.13/threading.py", line 1012, in _bootstrap 2687s self._bootstrap_inner() 2687s File "/usr/lib/python3.13/threading.py", line 1041, in _bootstrap_inner 2687s self.run() 2687s File "/usr/lib/python3.13/threading.py", line 992, in run 2687s self._target(*self._args, **self._kwargs) 2687s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 89, in _worker 2687s work_item = work_queue.get(block=True) 2687s +++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++ 2687s ERROR [ 84%] 2687s tests/test_utils_test.py::test_tls_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2687s tests/test_utils_test.py::test__UnhashableCallable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2687s tests/test_utils_test.py::test_dump_cluster_state_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 84%] 2687s tests/test_utils_test.py::test_assert_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2687s tests/test_utils_test.py::test_assert_story_malformed_story[Missing payload, stimulus_id, ts] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2687s tests/test_utils_test.py::test_assert_story_malformed_story[Missing (stimulus_id, ts)] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2687s tests/test_utils_test.py::test_assert_story_malformed_story[Missing ts] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2687s tests/test_utils_test.py::test_assert_story_malformed_story[ts is not a float] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2687s tests/test_utils_test.py::test_assert_story_malformed_story[ts is in the future] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2687s tests/test_utils_test.py::test_assert_story_malformed_story[ts is too old] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2687s tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is not a str] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2687s tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is an empty str] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2687s tests/test_utils_test.py::test_assert_story_malformed_story[no payload] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2687s tests/test_utils_test.py::test_assert_story_malformed_story[timestamps out of order] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2687s tests/test_utils_test.py::test_assert_story_identity[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2687s tests/test_utils_test.py::test_assert_story_identity[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2687s tests/test_utils_test.py::test_dump_cluster_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2687s tests/test_utils_test.py::test_dump_cluster_state_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2689s tests/test_utils_test.py::test_dump_cluster_state_nannies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2689s tests/test_utils_test.py::test_dump_cluster_state_unresponsive_local_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2689s tests/test_utils_test.py::test_dump_cluster_unresponsive_remote_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 85%] 2690s tests/test_utils_test.py::test_check_process_leak <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2692s tests/test_utils_test.py::test_check_process_leak_slow_cleanup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2693s tests/test_utils_test.py::test_check_process_leak_pre_cleanup[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2694s tests/test_utils_test.py::test_check_process_leak_pre_cleanup[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2695s tests/test_utils_test.py::test_check_process_leak_post_cleanup[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2696s tests/test_utils_test.py::test_check_process_leak_post_cleanup[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2698s tests/test_utils_test.py::test_start_failure_worker[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2699s tests/test_utils_test.py::test_start_failure_worker[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2700s tests/test_utils_test.py::test_start_failure_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2700s tests/test_utils_test.py::test_invalid_transitions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2700s tests/test_utils_test.py::test_invalid_worker_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2700s tests/test_utils_test.py::test_raises_with_cause <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2700s tests/test_utils_test.py::test_check_thread_leak <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 85%] 2700s tests/test_utils_test.py::test_fail_hard[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 2701s tests/test_utils_test.py::test_fail_hard[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 2701s tests/test_utils_test.py::test_popen_write_during_terminate_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 2711s tests/test_utils_test.py::test_popen_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 2711s tests/test_utils_test.py::test_popen_always_prints_output <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 2711s tests/test_utils_test.py::test_wait_for_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 2712s tests/test_utils_test.py::test_wait_for_stimulus <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 2712s tests/test_utils_test.py::test_ws_with_running_task[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 2712s tests/test_utils_test.py::test_ws_with_running_task[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 2712s tests/test_utils_test.py::test_sizeof <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 2712s tests/test_utils_test.py::test_sizeof_error[12345.0-TypeError-Expected integer] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 2712s tests/test_utils_test.py::test_sizeof_error[-1-ValueError-larger than] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 2712s tests/test_utils_test.py::test_sizeof_error[0-ValueError-larger than] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 2712s tests/test_utils_test.py::test_sizeof_error[10-ValueError-larger than] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 2712s tests/test_utils_test.py::test_captured_logger <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 2712s tests/test_utils_test.py::test_captured_context_meter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 2712s tests/test_variable.py::test_variable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 2712s tests/test_variable.py::test_delete_unset_variable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 2712s tests/test_variable.py::test_queue_with_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 2714s tests/test_variable.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 2714s tests/test_variable.py::test_hold_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 2714s tests/test_variable.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 2717s tests/test_variable.py::test_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 2717s tests/test_variable.py::test_cleanup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 2719s tests/test_variable.py::test_pickleable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 2719s tests/test_variable.py::test_timeout_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 2719s tests/test_variable.py::test_race <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py SKIPPED [ 86%] 2719s tests/test_variable.py::test_Future_knows_status_immediately <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 2720s tests/test_variable.py::test_erred_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 2724s tests/test_variable.py::test_future_erred_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 2724s tests/test_variable.py::test_variables_do_not_leak_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 2724s tests/test_variable.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 2724s tests/test_versions.py::test_versions_match <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 86%] 2724s tests/test_versions.py::test_version_mismatch[source-MISMATCHED] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_version_mismatch[source-MISSING] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_version_mismatch[source-KEY_ERROR] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_version_mismatch[source-NONE] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_version_mismatch[scheduler-MISMATCHED] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_version_mismatch[scheduler-MISSING] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_version_mismatch[scheduler-KEY_ERROR] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_version_mismatch[scheduler-NONE] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_version_mismatch[worker-1-MISMATCHED] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_version_mismatch[worker-1-MISSING] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_version_mismatch[worker-1-KEY_ERROR] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_version_mismatch[worker-1-NONE] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_scheduler_mismatched_irrelevant_package <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_scheduler_additional_irrelevant_package <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_python_mismatch[source] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_python_mismatch[scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_python_mismatch[worker-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_version_warning_in_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_python_version <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_versions.py::test_version_custom_pkgs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 2724s tests/test_worker.py::test_worker_nthreads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 2724s tests/test_worker.py::test_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 2724s tests/test_worker.py::test_identity <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 2724s tests/test_worker.py::test_worker_bad_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 2727s tests/test_worker.py::test_upload_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 2727s tests/test_worker.py::test_upload_file_pyc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 87%] 2727s tests/test_worker.py::test_upload_egg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 2727s tests/test_worker.py::test_upload_pyz <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 2727s tests/test_worker.py::test_upload_large_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 87%] 2727s tests/test_worker.py::test_broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 2727s tests/test_worker.py::test_worker_with_port_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 2727s tests/test_worker.py::test_worker_port_range <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 2727s tests/test_worker.py::test_worker_waits_for_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 2728s tests/test_worker.py::test_worker_task_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2728s tests/test_worker.py::test_error_message <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2728s tests/test_worker.py::test_chained_error_message <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2728s tests/test_worker.py::test_base_exception_in_task[BaseException-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 2728s tests/test_worker.py::test_base_exception_in_task[BaseException-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 2728s tests/test_worker.py::test_base_exception_in_task[SystemExit-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 2728s tests/test_worker.py::test_base_exception_in_task[SystemExit-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 2728s tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 2728s tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 2728s tests/test_worker.py::test_base_exception_in_task[CancelledError-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 2728s tests/test_worker.py::test_base_exception_in_task[CancelledError-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 2728s tests/test_worker.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2728s tests/test_worker.py::test_gather_missing_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2729s tests/test_worker.py::test_gather_missing_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2729s tests/test_worker.py::test_gather_missing_workers_replicated[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 2729s tests/test_worker.py::test_gather_missing_workers_replicated[True0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 2729s tests/test_worker.py::test_gather_missing_workers_replicated[True1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 2729s tests/test_worker.py::test_gather_missing_workers_replicated[True2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 2729s tests/test_worker.py::test_gather_missing_workers_replicated[True3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 2729s tests/test_worker.py::test_io_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2729s tests/test_worker.py::test_io_loop_alternate_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2729s tests/test_worker.py::test_access_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2729s tests/test_worker.py::test_run_dask_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2729s tests/test_worker.py::test_run_dask_worker_kwonlyarg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2729s tests/test_worker.py::test_run_coroutine_dask_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2729s tests/test_worker.py::test_Executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2730s tests/test_worker.py::test_close_on_disconnect <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2730s tests/test_worker.py::test_memory_limit_auto <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2730s tests/test_worker.py::test_inter_worker_communication <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2730s tests/test_worker.py::test_clean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2730s tests/test_worker.py::test_message_breakup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 2731s tests/test_worker.py::test_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2731s tests/test_worker.py::test_system_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2731s tests/test_worker.py::test_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2732s tests/test_worker.py::test_clean_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2733s tests/test_worker.py::test_gather_many_small[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2735s tests/test_worker.py::test_gather_many_small[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2735s tests/test_worker.py::test_multiple_transfers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2735s tests/test_worker.py::test_share_communication <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL [ 89%] 2735s tests/test_worker.py::test_dont_overlap_communications_to_same_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL [ 89%] 2735s tests/test_worker.py::test_log_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2736s tests/test_worker.py::test_log_exception_on_failed_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2736s tests/test_worker.py::test_clean_up_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2736s tests/test_worker.py::test_hold_onto_dependents <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2736s tests/test_worker.py::test_worker_death_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XPASS [ 89%] 2737s tests/test_worker.py::test_stop_doing_unnecessary_work <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2737s tests/test_worker.py::test_priorities <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2738s tests/test_worker.py::test_heartbeats <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2738s tests/test_worker.py::test_worker_dir[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2739s tests/test_worker.py::test_worker_dir[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2740s tests/test_worker.py::test_default_worker_dir <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2740s tests/test_worker.py::test_dataframe_attribute_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2740s tests/test_worker.py::test_pid <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2741s tests/test_worker.py::test_get_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2743s tests/test_worker.py::test_get_client_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2743s tests/test_worker.py::test_get_client_coroutine <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2745s tests/test_worker.py::test_get_client_coroutine_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL/distributed/pull/7339) [ 89%] 2745s tests/test_worker.py::test_global_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2745s tests/test_worker.py::test_worker_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2745s tests/test_worker.py::test_service_hosts_match_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2745s tests/test_worker.py::test_start_services <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2747s tests/test_worker.py::test_scheduler_delay <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 2748s tests/test_worker.py::test_statistical_profiling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2748s tests/test_worker.py::test_statistical_profiling_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 2748s tests/test_worker.py::test_statistical_profiling_cycle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2748s tests/test_worker.py::test_get_current_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2749s tests/test_worker.py::test_deque_handler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2749s tests/test_worker.py::test_scheduler_address_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2749s tests/test_worker.py::test_wait_for_outgoing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 2749s tests/test_worker.py::test_prefer_gather_from_local_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2750s tests/test_worker.py::test_avoid_oversubscription <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2750s tests/test_worker.py::test_custom_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2751s tests/test_worker.py::test_register_worker_callbacks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2751s tests/test_worker.py::test_register_worker_callbacks_err <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2751s tests/test_worker.py::test_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2751s tests/test_worker.py::test_local_directory_make_new_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2753s tests/test_worker.py::test_host_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2753s tests/test_worker.py::test_interface_async[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2755s tests/test_worker.py::test_interface_async[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2755s tests/test_worker.py::test_protocol_from_scheduler_address[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 2755s tests/test_worker.py::test_protocol_from_scheduler_address[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 2755s tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2757s tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2757s tests/test_worker.py::test_close_gracefully <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 2757s tests/test_worker.py::test_close_gracefully_no_suspicious_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 2758s tests/test_worker.py::test_close_while_executing[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2758s tests/test_worker.py::test_close_while_executing[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 2758s tests/test_worker.py::test_close_async_task_handles_cancellation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 2758s tests/test_worker.py::test_lifetime <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 2758s tests/test_worker.py::test_lifetime_stagger <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2758s tests/test_worker.py::test_bad_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2758s tests/test_worker.py::test_bad_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2758s tests/test_worker.py::test_update_latency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 2758s tests/test_worker.py::test_workerstate_executing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 2758s tests/test_worker.py::test_shutdown_on_scheduler_comm_closed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2758s tests/test_worker.py::test_heartbeat_comm_closed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2758s tests/test_worker.py::test_heartbeat_missing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2758s tests/test_worker.py::test_heartbeat_missing_real_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2758s tests/test_worker.py::test_heartbeat_missing_doesnt_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 91%] 2758s tests/test_worker.py::test_bad_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2759s tests/test_worker.py::test_taskstate_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2759s tests/test_worker.py::test_executor_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2759s tests/test_worker.py::test_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2759s tests/test_worker.py::test_stimulus_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2760s tests/test_worker.py::test_worker_descopes_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2762s tests/test_worker.py::test_gather_dep_one_worker_always_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2763s tests/test_worker.py::test_gather_dep_local_workers_first <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2764s tests/test_worker.py::test_gather_dep_from_remote_workers_if_all_local_workers_are_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2765s tests/test_worker.py::test_worker_client_uses_default_no_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2765s tests/test_worker.py::test_worker_client_closes_if_created_on_worker_one_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2765s tests/test_worker.py::test_worker_client_closes_if_created_on_worker_last_worker_alive <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2766s tests/test_worker.py::test_multiple_executors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2766s tests/test_worker.py::test_bad_executor_annotation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2766s tests/test_worker.py::test_process_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2767s tests/test_worker.py::test_process_executor_raise_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2767s tests/test_worker.py::test_worker_state_error_release_error_last <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2768s tests/test_worker.py::test_worker_state_error_release_error_first <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2768s tests/test_worker.py::test_worker_state_error_release_error_int <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2769s tests/test_worker.py::test_worker_state_error_long_chain <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2770s tests/test_worker.py::test_hold_on_to_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2770s tests/test_worker.py::test_forget_dependents_after_release <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2770s tests/test_worker.py::test_acquire_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2771s tests/test_worker.py::test_acquire_replicas_same_channel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2772s tests/test_worker.py::test_acquire_replicas_many <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2772s tests/test_worker.py::test_acquire_replicas_already_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 2772s tests/test_worker.py::test_forget_acquire_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 91%] 2773s tests/test_worker.py::test_remove_replicas_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2773s tests/test_worker.py::test_who_has_consistent_remove_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2773s tests/test_worker.py::test_acquire_replicas_with_no_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2774s tests/test_worker.py::test_acquire_replicas_large_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2774s tests/test_worker.py::test_missing_released_zombie_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2775s tests/test_worker.py::test_missing_released_zombie_tasks_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2775s tests/test_worker.py::test_worker_status_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2776s tests/test_worker.py::test_log_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2776s tests/test_worker.py::test_task_flight_compute_oserror <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2776s tests/test_worker.py::test_gather_dep_cancelled_rescheduled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2776s tests/test_worker.py::test_gather_dep_do_not_handle_response_of_not_requested_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2776s tests/test_worker.py::test_gather_dep_no_longer_in_flight_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2779s tests/test_worker.py::test_get_data_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2779s tests/test_worker.py::test_Worker__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2779s tests/test_worker.py::test_extension_methods <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2779s tests/test_worker.py::test_benchmark_hardware <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2779s tests/test_worker.py::test_tick_interval <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 92%] 2779s tests/test_worker.py::test_broken_comm <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 92%] 2779s tests/test_worker.py::test_do_not_block_event_loop_during_shutdown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2779s tests/test_worker.py::test_reconnect_argument_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2779s tests/test_worker.py::test_worker_running_before_running_plugins <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2780s tests/test_worker.py::test_execute_preamble_abort_retirement <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2780s tests/test_worker.py::test_deprecation_of_renamed_worker_attributes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2782s tests/test_worker.py::test_forward_output <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2782s tests/test_worker.py::test_offload_getdata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2783s tests/test_worker.py::test_startstops <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2783s tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[cancelled] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2783s tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[resumed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2784s tests/test_worker_client.py::test_submit_from_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 2784s tests/test_worker_client.py::test_submit_from_worker_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 2784s tests/test_worker_client.py::test_scatter_from_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 2784s tests/test_worker_client.py::test_scatter_singleton <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 2784s tests/test_worker_client.py::test_gather_multi_machine <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2785s tests/test_worker_client.py::test_same_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2788s tests/test_worker_client.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2789s tests/test_worker_client.py::test_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2789s tests/test_worker_client.py::test_separate_thread_false <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2789s tests/test_worker_client.py::test_client_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2789s tests/test_worker_client.py::test_local_client_warning <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2790s tests/test_worker_client.py::test_closing_worker_doesnt_close_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2792s tests/test_worker_client.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2792s tests/test_worker_client.py::test_secede_without_stealing_issue_1262 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2792s tests/test_worker_client.py::test_compute_within_worker_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2793s tests/test_worker_client.py::test_worker_client_rejoins <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2793s tests/test_worker_client.py::test_submit_different_names <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py XPASS [ 93%] 2794s tests/test_worker_client.py::test_secede_does_not_claim_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2794s tests/test_worker_memory.py::test_parse_memory_limit_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2794s tests/test_worker_memory.py::test_resource_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2794s tests/test_worker_memory.py::test_parse_memory_limit_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2794s tests/test_worker_memory.py::test_parse_memory_limit_worker_relative <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2796s tests/test_worker_memory.py::test_parse_memory_limit_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2797s tests/test_worker_memory.py::test_dict_data_if_no_spill_to_disk <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2797s tests/test_worker_memory.py::test_worker_data_callable_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2797s tests/test_worker_memory.py::test_worker_data_callable_local_directory_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2797s tests/test_worker_memory.py::test_worker_data_callable_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2797s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2797s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2797s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2797s tests/test_worker_memory.py::test_fail_to_pickle_execute_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2797s tests/test_worker_memory.py::test_fail_to_pickle_spill <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2797s tests/test_worker_memory.py::test_spill_target_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2798s tests/test_worker_memory.py::test_spill_constrained <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2798s tests/test_worker_memory.py::test_spill_spill_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2798s tests/test_worker_memory.py::test_spill_hysteresis[False-10000000000-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 2798s tests/test_worker_memory.py::test_spill_hysteresis[0.7-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2799s tests/test_worker_memory.py::test_spill_hysteresis[0.4-0-7] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2799s tests/test_worker_memory.py::test_pause_executor_manual <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2800s tests/test_worker_memory.py::test_pause_executor_with_memory_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2800s tests/test_worker_memory.py::test_pause_prevents_deps_fetch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2800s tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2803s tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2803s tests/test_worker_memory.py::test_override_data_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2806s tests/test_worker_memory.py::test_override_data_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2807s tests/test_worker_memory.py::test_override_data_vs_memory_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2807s tests/test_worker_memory.py::test_manual_evict_proto <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2807s tests/test_worker_memory.py::test_nanny_terminate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 2807s tests/test_worker_memory.py::test_disk_cleanup_on_terminate[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 2807s tests/test_worker_memory.py::test_disk_cleanup_on_terminate[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 2808s tests/test_worker_memory.py::test_pause_while_spilling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2808s tests/test_worker_memory.py::test_release_evloop_while_spilling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 2808s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_limit-123000000000.0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2808s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_target_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2808s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_spill_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2808s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_pause_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2810s tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_limit-123000000000.0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2813s tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_terminate_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2813s tests/test_worker_memory.py::test_deprecated_memory_monitor_method_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2816s tests/test_worker_memory.py::test_deprecated_memory_monitor_method_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2816s tests/test_worker_memory.py::test_deprecated_params[memory_target_fraction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2816s tests/test_worker_memory.py::test_deprecated_params[memory_spill_fraction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2816s tests/test_worker_memory.py::test_deprecated_params[memory_pause_fraction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2817s tests/test_worker_memory.py::test_pause_while_idle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2818s tests/test_worker_memory.py::test_pause_while_saturated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2818s tests/test_worker_memory.py::test_worker_log_memory_limit_too_high <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2818s tests/test_worker_memory.py::test_high_unmanaged_memory_warning <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2818s tests/test_worker_memory.py::test_delete_spilled_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2818s tests/test_worker_metrics.py::test_task_lifecycle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2819s tests/test_worker_metrics.py::test_async_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2819s tests/test_worker_metrics.py::test_custom_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2819s tests/test_worker_metrics.py::test_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2820s tests/test_worker_metrics.py::test_execute_failed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2820s tests/test_worker_metrics.py::test_cancelled_execute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2820s tests/test_worker_metrics.py::test_cancelled_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2821s tests/test_worker_metrics.py::test_gather_dep_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2822s tests/test_worker_metrics.py::test_gather_dep_no_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2822s tests/test_worker_metrics.py::test_gather_dep_failed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2823s tests/test_worker_metrics.py::test_gather_dep_network_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2823s tests/test_worker_metrics.py::test_memory_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2824s tests/test_worker_metrics.py::test_user_metrics_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2824s tests/test_worker_metrics.py::test_user_metrics_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2824s tests/test_worker_metrics.py::test_user_metrics_fail <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2824s tests/test_worker_metrics.py::test_user_metrics_weird <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2827s tests/test_worker_metrics.py::test_do_not_leak_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2828s tests/test_worker_metrics.py::test_reschedule <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2828s tests/test_worker_metrics.py::test_send_metrics_to_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2829s tests/test_worker_metrics.py::test_no_spans_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2829s tests/test_worker_metrics.py::test_new_metrics_during_heartbeat <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2831s tests/test_worker_metrics.py::test_delayed_ledger_is_not_reentrant <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2831s tests/test_worker_metrics.py::test_int_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2831s tests/test_worker_state_machine.py::test_instruction_match <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 2832s tests/test_worker_state_machine.py::test_TaskState_tracking <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 2832s tests/test_worker_state_machine.py::test_TaskState_get_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 2832s tests/test_worker_state_machine.py::test_TaskState_eq <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 2832s tests/test_worker_state_machine.py::test_TaskState__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 2832s tests/test_worker_state_machine.py::test_TaskState_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 2832s tests/test_worker_state_machine.py::test_WorkerState__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 2832s tests/test_worker_state_machine.py::test_WorkerState_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 2832s tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTransition-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 2832s tests/test_worker_state_machine.py::test_pickle_exceptions[False-TransitionCounterMaxExceeded-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTaskState-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTransition-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_pickle_exceptions[True-TransitionCounterMaxExceeded-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTaskState-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[TaskState] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[Instruction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[GatherDep] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[Execute] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerLater] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[SendMessageToScheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[TaskFinishedMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[TaskErredMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[ReleaseWorkerDataMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[RescheduleMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[LongRunningMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[AddKeysMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[RequestRefreshWhoHasMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[StealResponseMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[StateMachineEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[PauseEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[UnpauseEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[GatherDepDoneEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[GatherDepSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[GatherDepBusyEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[GatherDepNetworkFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[GatherDepFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[RemoveWorkerEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[ComputeTaskEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[ExecuteDoneEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2832s tests/test_worker_state_machine.py::test_slots[ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_slots[RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_slots[CancelComputeEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_slots[FindMissingEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_slots[RefreshWhoHasEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_slots[AcquireReplicasEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_slots[RemoveReplicasEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_slots[FreeKeysEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_slots[StealRequestEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_slots[UpdateDataEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_slots[SecedeEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_sendmsg_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_merge_recs_instructions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_event_to_dict_with_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_event_to_dict_without_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_computetask_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_computetask_dummy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_updatedata_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_executesuccess_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_executesuccess_dummy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_executefailure_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_executefailure_dummy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_fetch_to_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_fetch_via_amm_to_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2832s tests/test_worker_state_machine.py::test_lose_replica_during_fetch[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2833s tests/test_worker_state_machine.py::test_lose_replica_during_fetch[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2833s tests/test_worker_state_machine.py::test_fetch_to_missing_on_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2833s tests/test_worker_state_machine.py::test_new_replica_while_all_workers_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2833s tests/test_worker_state_machine.py::test_cancelled_while_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2833s tests/test_worker_state_machine.py::test_in_memory_while_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2834s tests/test_worker_state_machine.py::test_forget_data_needed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2834s tests/test_worker_state_machine.py::test_missing_handle_compute_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2834s tests/test_worker_state_machine.py::test_missing_to_waiting <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_fetch_to_missing_on_refresh_who_has <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_fetch_to_missing_on_network_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_deprecated_worker_attributes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_gather_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_task_acquires_resources[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_task_acquires_resources[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_task_releases_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_task_with_dependencies_acquires_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_clean_log <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2835s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_gather_dep_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_recompute_erred_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_transfer_incoming_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_throttling_does_not_affect_first_transfer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_message_target_does_not_affect_first_transfer_on_different_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_throttle_incoming_transfers_on_count_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_same_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_different_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_do_not_throttle_connections_while_below_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_throttle_on_transfer_bytes_regardless_of_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_worker_nbytes[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_worker_nbytes[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2835s tests/test_worker_state_machine.py::test_fetch_count <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2836s tests/test_worker_state_machine.py::test_task_counter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2836s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[fail] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2836s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[success] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2836s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[no-key] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2836s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[busy] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2836s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight_unused_peer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2836s tests/test_worker_state_machine.py::test_remove_worker_while_in_fetch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2836s tests/test_worker_state_machine.py::test_remove_worker_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [100%] 2836s 2836s ==================================== ERRORS ==================================== 2836s ______________________ ERROR at setup of test_tls_cluster ______________________ 2836s 2836s loop = 2836s security = Security(require_encryption=True, tls_ca_file=Local (/usr/lib/python3/dist-packages/distributed/tests/tls-ca-cert.pem)...ted/tests/tls-key-cert.pem), tls_worker_cert=Local (/usr/lib/python3/dist-packages/distributed/tests/tls-key-cert.pem)) 2836s 2836s @pytest.fixture 2836s def tls_cluster(loop, security): 2836s > with tls_cluster_context(security=security) as (scheduler, workers): 2836s 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:573: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3.13/contextlib.py:141: in __enter__ 2836s return next(self.gen) 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:565: in tls_cluster_context 2836s with cluster( 2836s /usr/lib/python3.13/contextlib.py:141: in __enter__ 2836s return next(self.gen) 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:672: in cluster 2836s pid, addr_or_exception = q.get() 2836s /usr/lib/python3.13/multiprocessing/queues.py:101: in get 2836s res = self._recv_bytes() 2836s /usr/lib/python3.13/multiprocessing/connection.py:216: in recv_bytes 2836s buf = self._recv_bytes(maxlength) 2836s /usr/lib/python3.13/multiprocessing/connection.py:430: in _recv_bytes 2836s buf = self._recv(4) 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s size = 4, read = 2836s 2836s def _recv(self, size, read=_read): 2836s buf = io.BytesIO() 2836s handle = self._handle 2836s remaining = size 2836s while remaining > 0: 2836s > chunk = read(handle, remaining) 2836s E Failed: Timeout >300.0s 2836s 2836s /usr/lib/python3.13/multiprocessing/connection.py:395: Failed 2836s ---------------------------- Captured stderr setup ----------------------------- 2836s 2024-11-24 00:57:19,174 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 2836s 2024-11-24 00:57:19,177 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:57:19,178 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-rat6s3qo', purging 2836s 2024-11-24 00:57:19,179 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-qsej2qkq', purging 2836s 2024-11-24 00:57:19,179 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-nntwvto2', purging 2836s 2024-11-24 00:57:19,183 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:19,183 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:8787/status 2836s 2024-11-24 00:57:19,183 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:57:19,190 - distributed.worker.memory - WARNING - Ignoring provided memory limit 8302133248 due to system memory limit of 7.73 GiB 2836s 2024-11-24 00:57:19,208 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37939 2836s 2024-11-24 00:57:19,209 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37939 2836s 2024-11-24 00:57:19,209 - distributed.worker - INFO - dashboard at: 127.0.0.1:37061 2836s 2024-11-24 00:57:19,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:19,209 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:57:19,209 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:57:19,209 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:57:19,209 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rodopf88 2836s 2024-11-24 00:57:19,209 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:57:19,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:19,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:19,293 - distributed.worker.memory - WARNING - Ignoring provided memory limit 8302133248 due to system memory limit of 7.73 GiB 2836s 2024-11-24 00:57:19,312 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45599 2836s 2024-11-24 00:57:19,312 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45599 2836s 2024-11-24 00:57:19,312 - distributed.worker - INFO - dashboard at: 127.0.0.1:37491 2836s 2024-11-24 00:57:19,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:19,312 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:57:19,312 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:57:19,312 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:57:19,312 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q_xxznm4 2836s 2024-11-24 00:57:19,312 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:57:19,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:19,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:19,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:19,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:19,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:19,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:19,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:19,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:19,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:19,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:19,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:19,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:19,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:19,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:19,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:19,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:19,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:19,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:19,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:19,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:19,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:19,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:19,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:19,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:19,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:19,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:19,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:19,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:20,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:20,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:21,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:21,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:22,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:22,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:23,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:23,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:24,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:24,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:24,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:24,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:24,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:24,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:24,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:24,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:24,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:24,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:24,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:24,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:24,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:24,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:24,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:24,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:24,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:24,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:25,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:25,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:26,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:26,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:27,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:27,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:28,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:28,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:29,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:29,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:30,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:30,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:31,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:31,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:32,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:32,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:33,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:33,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:34,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:34,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:35,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:35,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:36,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:36,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:37,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:37,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:38,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:38,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:39,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:39,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:40,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:40,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:41,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:41,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:42,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:42,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:43,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:43,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:44,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:44,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:45,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:45,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:46,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:46,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:47,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:47,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:48,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:48,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:49,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:49,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:50,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:50,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:51,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:51,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:52,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:52,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:53,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:53,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:54,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:54,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:55,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:55,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:56,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:56,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:57,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:57,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:58,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:58,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:57:59,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:57:59,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:00,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:00,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:01,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:01,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:02,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:02,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:03,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:03,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:04,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:04,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:05,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:05,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:06,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:06,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:07,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:07,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:08,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:08,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:09,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:09,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:10,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:10,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:11,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:11,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:12,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:12,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:13,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:13,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:13,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:13,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:13,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:13,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:13,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:13,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:13,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:13,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:13,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:13,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:13,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:13,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:13,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:13,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:13,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:13,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:14,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:14,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:15,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:15,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:15,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:38722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:15,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:15,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:15,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:15,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:15,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:15,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:15,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:15,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:15,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:15,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:15,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:15,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:15,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:15,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:15,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:16,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:16,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:17,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:17,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:18,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:18,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:19,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:19,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:20,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:20,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:42994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:21,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:21,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:22,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:22,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:23,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:23,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:24,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:24,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:25,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:25,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:26,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:26,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:27,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:27,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:28,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:28,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:29,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:29,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:30,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:30,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:31,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:31,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:32,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:32,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:33,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:33,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:33,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:33,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:33,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:33,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:33,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:33,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:33,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:33,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:33,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:33,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:33,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:33,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:33,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:33,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:33,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:33,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:34,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:34,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:35,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:35,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:36,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:36,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:37,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:37,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:38,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:38,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:39,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:39,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:40,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:40,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:41,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:41,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:42,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:42,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:43,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:43,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:44,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:44,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:44,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:44,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:44,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:44,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:44,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:44,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:44,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:44,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:44,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:44,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:44,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:44,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:44,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:44,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:44,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:44,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:45,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:45,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:46,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:46,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:47,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:47,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:48,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:48,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:49,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:49,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:50,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:50,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:51,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:51,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:52,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:52,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:53,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:53,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:54,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:54,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:57892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:55,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:55,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:56,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:56,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:57,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:57,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:58,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:58,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:58:59,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:58:59,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:00,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:00,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:01,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:01,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:02,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:02,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:03,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:03,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:04,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:04,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:05,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:05,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:06,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:06,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:07,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:07,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:08,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:08,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:09,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:09,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:10,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:10,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:11,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:11,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:12,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:12,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:13,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:13,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:14,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:14,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:15,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:15,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:16,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:16,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:17,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:17,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:18,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:18,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:19,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:19,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:20,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:20,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:21,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:21,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:22,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:22,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:23,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:23,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:24,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:24,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:24,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:24,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:24,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:24,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:24,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:24,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:24,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:24,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:24,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:24,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:24,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:24,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:24,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:24,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:24,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:24,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:25,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:25,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:26,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:26,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:27,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:27,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:28,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:28,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:29,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:29,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:30,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:30,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:49992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:31,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:31,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:32,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:32,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:33,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:33,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:34,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:34,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:50582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:35,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:35,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:36,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:36,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:37,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:37,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:33986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:38,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:38,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:39,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:39,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:40,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:40,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:41,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:41,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:42,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:42,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:43,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:43,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:44,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:44,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:45,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:45,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:46,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:46,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:47,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:47,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:48,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:48,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:49,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:49,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:50,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:50,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:50,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:50,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:50,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:50,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:50,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:50,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:50,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:50,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:50,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:50,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:50,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:50,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:50,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:50,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:50,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:50,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:51,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:51,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:52,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:52,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:53,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:53,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:54,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:54,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:55,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:55,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:56,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:56,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:57,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:57,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:58,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:58,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 00:59:59,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:59:59,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:00,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:00,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:01,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:01,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:02,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:02,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:03,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:03,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:04,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:04,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:04,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:04,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:04,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:04,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:04,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:04,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:04,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:04,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:04,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:04,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:04,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:04,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:04,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:04,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:04,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:04,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:05,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:05,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:06,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:06,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:06,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:06,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:06,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:06,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:06,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:06,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:06,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:06,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:06,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:06,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:06,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:06,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:06,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:06,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:06,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:06,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:34994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:07,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:07,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:08,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:08,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:08,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:08,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:08,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:08,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:08,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:08,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:08,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:08,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:08,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:08,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:08,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:08,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:08,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:08,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:08,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:08,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:09,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:09,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:10,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:10,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:10,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:10,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:10,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:10,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:10,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:10,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:10,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:10,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:10,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:10,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:10,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:10,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:10,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:10,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:10,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:10,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:11,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:11,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:12,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:12,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:13,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:13,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:14,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:14,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:15,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:15,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:16,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:16,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:17,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:17,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:17,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:17,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:17,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:17,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:17,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:17,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:17,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:17,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:17,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:17,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:17,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:17,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:17,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:17,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:17,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:17,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:18,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:18,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:19,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:19,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:20,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:20,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:21,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:21,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:22,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:22,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:23,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:23,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:24,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:24,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:24,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:24,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:24,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:24,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:24,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:24,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:24,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:24,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:24,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:24,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:24,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:24,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:24,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:24,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:24,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:24,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:25,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:25,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:26,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:26,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:27,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:27,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:28,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:28,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:29,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:29,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:30,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:30,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:30,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:30,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:30,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:30,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:30,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:30,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:30,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:30,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:30,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:30,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:30,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:30,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:30,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:30,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:30,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:30,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:31,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:31,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:32,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:32,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:32,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:32,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:32,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:32,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:32,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:32,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:32,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:32,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:32,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:32,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:32,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:32,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:32,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:32,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:32,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:32,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:33,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:33,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:33,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:33,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:33,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:33,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:33,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:33,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:33,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:33,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:33,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:33,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:33,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:33,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:33,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:33,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:33,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:33,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:34,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:34,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:37968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:35,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:35,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:36,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:36,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:37,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:37,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:38,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:38,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:39,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:39,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:40,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:40,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:41,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:41,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:42,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:42,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:43,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:43,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:44,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:44,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:45,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:45,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:45,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:45,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:45,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:45,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:45,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:45,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:45,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:45,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:45,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:45,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:45,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:45,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:45,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:45,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:45,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:45,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:46,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:46,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:47,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:47,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:48,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:48,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:49,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:49,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:50,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:50,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:51,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:51,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:51,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:51,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:51,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:51,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:51,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:51,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:51,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:51,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:51,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:51,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:51,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:51,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:51,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:51,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:51,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:51,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:52,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:52,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:53,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:53,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:54,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:54,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:55,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:55,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:56,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:56,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:57,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:57,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:58998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:58,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:58,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:00:59,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:00:59,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:00,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:00,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:01,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:01,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:02,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:02,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:02,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:02,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:02,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:02,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:02,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:02,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:02,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:02,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:02,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:02,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:02,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:02,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:02,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:02,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:02,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:02,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:03,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:03,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:04,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:04,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:60170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:05,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:05,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:06,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:06,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:07,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:07,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:39992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:08,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:08,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:09,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:09,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:10,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:10,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:11,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:11,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:12,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:12,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:13,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:13,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:40996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:14,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:14,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:41090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:15,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:15,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:16,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:16,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:17,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:17,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:18,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:18,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:19,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:19,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:20,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:20,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:21,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:21,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:55992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:22,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:22,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:23,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:23,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:24,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:24,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:56384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:25,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:25,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:26,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:26,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:43986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:27,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:27,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:28,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:28,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:29,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:29,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:29,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:29,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:29,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:29,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:29,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:29,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:29,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:29,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:29,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:29,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:29,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:29,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:29,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:29,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:29,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:29,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:30,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:30,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:31,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:31,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:32,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:32,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:44994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:33,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:33,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:34,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:34,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:45338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:35,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:35,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:36,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:36,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:37,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:37,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:38,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:38,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:38,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:38,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:38,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:38,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:38,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:38,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:38,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:38,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:38,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:38,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:38,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:38,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:38,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:38,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:38,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:38,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:39,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:39,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:40,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:40,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:41,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:41,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:42,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:42,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:43,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:43,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:44,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:44,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:36728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:45,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:45,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:46,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:46,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:47,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:47,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:51998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:48,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:48,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:49,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:49,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:50,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:50,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:51,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:51,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:52,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:52,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:52998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:53,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:53,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:54,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:54,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:55,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:55,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:56,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:56,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:56,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:56,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:56,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:56,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:56,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:56,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:56,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:56,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:56,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:56,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:56,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:56,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:56,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:56,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:56,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:56,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:57,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:57,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:58,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:58,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:58,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:58,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:58,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:58,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:58,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:58,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:58,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:58,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:58,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:58,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:58,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:58,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:58,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:46994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:58,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:58,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:58,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:01:59,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:01:59,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:00,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:00,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:01,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:01,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:02,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:02,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:03,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:03,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:47994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:04,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:04,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:48074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:05,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:05,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:06,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:06,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:07,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:07,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:07,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:07,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:07,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:07,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:07,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:07,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:07,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:07,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:07,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:07,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:07,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:07,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:07,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:07,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:07,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:07,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:08,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:08,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:53988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:09,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:09,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:10,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:10,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:11,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:11,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:12,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:12,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:13,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:13,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:14,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:14,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:54890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:15,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:15,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:16,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:16,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:17,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:17,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:18,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:18,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s 2024-11-24 01:02:18,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:59536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 01:02:18,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 2836s =================================== FAILURES =================================== 2836s ______________________________ test_preload_file _______________________________ 2836s 2836s self = 2836s deserializers = None 2836s 2836s async def read(self, deserializers=None): 2836s stream = self.stream 2836s if stream is None: 2836s raise CommClosedError() 2836s 2836s fmt = "Q" 2836s fmt_size = struct.calcsize(fmt) 2836s 2836s try: 2836s # Don't store multiple numpy or parquet buffers into the same buffer, or 2836s # none will be released until all are released. 2836s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 2836s E tornado.iostream.StreamClosedError: Stream is closed 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s loop = 2836s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-0/test_preload_file0') 2836s 2836s def test_preload_file(loop, tmp_path): 2836s def check_scheduler(): 2836s import scheduler_info 2836s 2836s return scheduler_info.get_scheduler_address() 2836s 2836s path = tmp_path / "scheduler_info.py" 2836s with open(path, "w") as f: 2836s f.write(PRELOAD_TEXT) 2836s with tmpfile() as fn: 2836s with popen( 2836s [ 2836s "dask", 2836s "scheduler", 2836s "--scheduler-file", 2836s fn, 2836s "--preload", 2836s path, 2836s f"--port={open_port()}", 2836s ] 2836s ): 2836s with Client(scheduler_file=fn, loop=loop) as c: 2836s > assert c.run_on_scheduler(check_scheduler) == c.scheduler.address 2836s 2836s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:342: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 2836s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 2836s return sync( 2836s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 2836s raise error 2836s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 2836s result = yield future 2836s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 2836s value = future.result() 2836s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 2836s response = await self.scheduler.run_function( 2836s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 2836s return await send_recv(comm=comm, op=key, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 2836s response = await comm.read(deserializers=deserializers) 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 2836s convert_stream_closed_error(self, e) 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s obj = 2836s exc = StreamClosedError('Stream is closed') 2836s 2836s def convert_stream_closed_error(obj, exc): 2836s """ 2836s Re-raise StreamClosedError as CommClosedError. 2836s """ 2836s if exc.real_error is not None: 2836s # The stream was closed because of an underlying OS error 2836s exc = exc.real_error 2836s if isinstance(exc, ssl.SSLError): 2836s if exc.reason and "UNKNOWN_CA" in exc.reason: 2836s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 2836s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 2836s else: 2836s > raise CommClosedError(f"in {obj}: {exc}") from exc 2836s E distributed.comm.core.CommClosedError: in : Stream is closed 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 2836s ----------------------------- Captured stderr call ----------------------------- 2836s 2024-11-24 00:28:28,744 - distributed.utils - INFO - Reload module scheduler_info from .py file 2836s 2024-11-24 00:28:28,745 - distributed.preloading - INFO - Import preload module: /tmp/pytest-of-ubuntu/pytest-0/test_preload_file0/scheduler_info.py 2836s 2024-11-24 00:28:28,745 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:28:28,747 - distributed.preloading - INFO - Creating preload: /tmp/pytest-of-ubuntu/pytest-0/test_preload_file0/scheduler_info.py 2836s 2024-11-24 00:28:28,747 - distributed.utils - INFO - Reload module scheduler_info from .py file 2836s 2024-11-24 00:28:28,747 - distributed.preloading - INFO - Import preload module: /tmp/pytest-of-ubuntu/pytest-0/test_preload_file0/scheduler_info.py 2836s 2024-11-24 00:28:28,763 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 2836s 2024-11-24 00:28:28,766 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:28:28,770 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:28:28,770 - distributed.scheduler - INFO - Scheduler at: tcp://10.145.243.241:44997 2836s 2024-11-24 00:28:28,771 - distributed.scheduler - INFO - dashboard at: http://10.145.243.241:8787/status 2836s 2024-11-24 00:28:28,771 - distributed.preloading - INFO - Run preload setup: /tmp/pytest-of-ubuntu/pytest-0/test_preload_file0/scheduler_info.py 2836s 2024-11-24 00:28:28,771 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:28:28,780 - distributed.scheduler - INFO - Receive client connection: Client-067e3559-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:28:29,009 - distributed.core - INFO - Starting established connection to tcp://10.145.243.241:56622 2836s 2024-11-24 00:28:29,012 - distributed.worker - INFO - Run out-of-band function 'check_scheduler' 2836s 2024-11-24 00:28:29,287 - distributed.client - ERROR - 2836s ConnectionRefusedError: [Errno 111] Connection refused 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 2836s convert_stream_closed_error(self, e) 2836s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 2836s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 2836s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 2836s 2836s During handling of the above exception, another exception occurred: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 2836s return await func(*args, **kwargs) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 2836s await self._ensure_connected(timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 2836s comm = await connect( 2836s ^^^^^^^^^^^^^^ 2836s self.scheduler.address, timeout=timeout, **self.connection_args 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 2836s await asyncio.sleep(backoff) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2836s return await future 2836s ^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s _____________________________ test_preload_module ______________________________ 2836s 2836s self = 2836s deserializers = None 2836s 2836s async def read(self, deserializers=None): 2836s stream = self.stream 2836s if stream is None: 2836s raise CommClosedError() 2836s 2836s fmt = "Q" 2836s fmt_size = struct.calcsize(fmt) 2836s 2836s try: 2836s # Don't store multiple numpy or parquet buffers into the same buffer, or 2836s # none will be released until all are released. 2836s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 2836s E tornado.iostream.StreamClosedError: Stream is closed 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s loop = 2836s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-0/test_preload_module0') 2836s 2836s def test_preload_module(loop, tmp_path): 2836s def check_scheduler(): 2836s import scheduler_info 2836s 2836s return scheduler_info.get_scheduler_address() 2836s 2836s path = tmp_path / "scheduler_info.py" 2836s with open(path, "w") as f: 2836s f.write(PRELOAD_TEXT) 2836s env = os.environ.copy() 2836s if "PYTHONPATH" in env: 2836s env["PYTHONPATH"] = str(tmp_path) + ":" + env["PYTHONPATH"] 2836s else: 2836s env["PYTHONPATH"] = str(tmp_path) 2836s with tmpfile() as fn: 2836s with popen( 2836s [ 2836s "dask", 2836s "scheduler", 2836s "--scheduler-file", 2836s fn, 2836s "--preload", 2836s "scheduler_info", 2836s f"--port={open_port()}", 2836s ], 2836s env=env, 2836s ): 2836s with Client(scheduler_file=fn, loop=loop) as c: 2836s > assert c.run_on_scheduler(check_scheduler) == c.scheduler.address 2836s 2836s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:373: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 2836s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 2836s return sync( 2836s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 2836s raise error 2836s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 2836s result = yield future 2836s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 2836s value = future.result() 2836s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 2836s response = await self.scheduler.run_function( 2836s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 2836s return await send_recv(comm=comm, op=key, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 2836s response = await comm.read(deserializers=deserializers) 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 2836s convert_stream_closed_error(self, e) 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s obj = 2836s exc = StreamClosedError('Stream is closed') 2836s 2836s def convert_stream_closed_error(obj, exc): 2836s """ 2836s Re-raise StreamClosedError as CommClosedError. 2836s """ 2836s if exc.real_error is not None: 2836s # The stream was closed because of an underlying OS error 2836s exc = exc.real_error 2836s if isinstance(exc, ssl.SSLError): 2836s if exc.reason and "UNKNOWN_CA" in exc.reason: 2836s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 2836s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 2836s else: 2836s > raise CommClosedError(f"in {obj}: {exc}") from exc 2836s E distributed.comm.core.CommClosedError: in : Stream is closed 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 2836s ----------------------------- Captured stderr call ----------------------------- 2836s 2024-11-24 00:28:30,027 - distributed.preloading - INFO - Import preload module: scheduler_info 2836s 2024-11-24 00:28:30,027 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:28:30,029 - distributed.preloading - INFO - Creating preload: scheduler_info 2836s 2024-11-24 00:28:30,029 - distributed.preloading - INFO - Import preload module: scheduler_info 2836s 2024-11-24 00:28:30,043 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 2836s 2024-11-24 00:28:30,046 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:28:30,046 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-vni79q1z', purging 2836s 2024-11-24 00:28:30,049 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:28:30,050 - distributed.scheduler - INFO - Scheduler at: tcp://10.145.243.241:42059 2836s 2024-11-24 00:28:30,050 - distributed.scheduler - INFO - dashboard at: http://10.145.243.241:8787/status 2836s 2024-11-24 00:28:30,050 - distributed.preloading - INFO - Run preload setup: scheduler_info 2836s 2024-11-24 00:28:30,050 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:28:30,056 - distributed.scheduler - INFO - Receive client connection: Client-0743bafb-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:28:30,299 - distributed.core - INFO - Starting established connection to tcp://10.145.243.241:48854 2836s 2024-11-24 00:28:30,302 - distributed.worker - INFO - Run out-of-band function 'check_scheduler' 2836s 2024-11-24 00:28:30,566 - distributed.client - ERROR - 2836s ConnectionRefusedError: [Errno 111] Connection refused 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 2836s convert_stream_closed_error(self, e) 2836s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 2836s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 2836s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 2836s 2836s During handling of the above exception, another exception occurred: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 2836s return await func(*args, **kwargs) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 2836s await self._ensure_connected(timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 2836s comm = await connect( 2836s ^^^^^^^^^^^^^^ 2836s self.scheduler.address, timeout=timeout, **self.connection_args 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 2836s await asyncio.sleep(backoff) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2836s return await future 2836s ^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s __________________________ test_preload_remote_module __________________________ 2836s 2836s loop = 2836s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-0/test_preload_remote_module0') 2836s 2836s def test_preload_remote_module(loop, tmp_path): 2836s with open(tmp_path / "scheduler_info.py", "w") as f: 2836s f.write(PRELOAD_TEXT) 2836s http_server_port = open_port() 2836s with popen( 2836s [sys.executable, "-m", "http.server", str(http_server_port)], cwd=tmp_path 2836s ): 2836s with popen( 2836s [ 2836s "dask", 2836s "scheduler", 2836s "--scheduler-file", 2836s str(tmp_path / "scheduler-file.json"), 2836s "--preload", 2836s f"http://localhost:{http_server_port}/scheduler_info.py", 2836s f"--port={open_port()}", 2836s ] 2836s ) as proc: 2836s with Client( 2836s scheduler_file=tmp_path / "scheduler-file.json", loop=loop 2836s ) as c: 2836s > assert ( 2836s c.run_on_scheduler( 2836s lambda dask_scheduler: getattr(dask_scheduler, "foo", None) 2836s ) 2836s == "bar" 2836s ) 2836s 2836s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:397: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 2836s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 2836s return sync( 2836s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 2836s raise error 2836s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 2836s result = yield future 2836s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 2836s value = future.result() 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s function = . at 0xe63f78560b80> 2836s wait = True, args = (), kwargs = {} 2836s response = {'exception': b'\x80\x05\x95&\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\x8c\x12unpickle_exception\... 'exception_text': "SystemError('no locals when deleting ')", 'status': 'error', 'traceback': b'\x80\x05N.', ...} 2836s typ = , exc = SystemError('no locals when deleting ') 2836s tb = None 2836s 2836s async def _run_on_scheduler(self, function, *args, wait=True, **kwargs): 2836s response = await self.scheduler.run_function( 2836s function=dumps(function), 2836s args=dumps(args), 2836s kwargs=dumps(kwargs), 2836s wait=wait, 2836s ) 2836s if response["status"] == "error": 2836s typ, exc, tb = clean_exception(**response) 2836s > raise exc.with_traceback(tb) 2836s E SystemError: no locals when deleting 2836s 2836s /usr/lib/python3/dist-packages/distributed/client.py:2817: SystemError 2836s ----------------------------- Captured stdout call ----------------------------- 2836s Serving HTTP on 0.0.0.0 port 36931 (http://0.0.0.0:36931/) ... 2836s 2836s Keyboard interrupt received, exiting. 2836s ----------------------------- Captured stderr call ----------------------------- 2836s 2024-11-24 00:28:31,297 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:28:31,298 - distributed.preloading - INFO - Creating preload: http://localhost:36931/scheduler_info.py 2836s 2024-11-24 00:28:31,298 - distributed.preloading - INFO - Downloading preload at http://localhost:36931/scheduler_info.py 2836s 127.0.0.1 - - [24/Nov/2024 00:28:31] "GET /scheduler_info.py HTTP/1.1" 200 - 2836s 2024-11-24 00:28:31,340 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 2836s 2024-11-24 00:28:31,342 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:28:31,343 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-3zz78g8m', purging 2836s 2024-11-24 00:28:31,346 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:28:31,347 - distributed.scheduler - INFO - Scheduler at: tcp://10.145.243.241:42517 2836s 2024-11-24 00:28:31,347 - distributed.scheduler - INFO - dashboard at: http://10.145.243.241:8787/status 2836s 2024-11-24 00:28:31,347 - distributed.preloading - INFO - Run preload setup: http://localhost:36931/scheduler_info.py 2836s 2024-11-24 00:28:31,348 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:28:31,356 - distributed.scheduler - INFO - Receive client connection: Client-08008e4e-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:28:31,604 - distributed.core - INFO - Starting established connection to tcp://10.145.243.241:46012 2836s 2024-11-24 00:28:31,607 - distributed.worker - INFO - Run out-of-band function 'lambda' 2836s 2024-11-24 00:28:31,607 - distributed.worker - WARNING - Run Failed 2836s Function: lambda 2836s args: () 2836s kwargs: {'dask_scheduler': } 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 3182, in run 2836s result = function(*args, **kwargs) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s SystemError: no locals when deleting 2836s 2024-11-24 00:28:31,616 - distributed.scheduler - INFO - Remove client Client-08008e4e-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:28:31,617 - distributed.core - INFO - Received 'close-stream' from tcp://10.145.243.241:46012; closing. 2836s 2024-11-24 00:28:31,617 - distributed.scheduler - INFO - Remove client Client-08008e4e-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:28:31,617 - distributed.scheduler - INFO - Close client connection: Client-08008e4e-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:28:31,617 - distributed._signals - INFO - Received signal SIGINT (2) 2836s 2024-11-24 00:28:31,618 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 2836s 2024-11-24 00:28:31,618 - distributed.scheduler - INFO - Scheduler closing all comms 2836s 2024-11-24 00:28:31,618 - distributed.scheduler - INFO - Stopped scheduler at 'tcp://10.145.243.241:42517' 2836s 2024-11-24 00:28:31,619 - distributed.scheduler - INFO - End scheduler 2836s _____________________________ test_preload_config ______________________________ 2836s 2836s loop = 2836s 2836s def test_preload_config(loop): 2836s # Ensure dask scheduler pulls the preload from the Dask config if 2836s # not specified via a command line option 2836s with tmpfile() as fn: 2836s env = os.environ.copy() 2836s env["DASK_DISTRIBUTED__SCHEDULER__PRELOAD"] = PRELOAD_TEXT 2836s with popen(["dask", "scheduler", "--scheduler-file", fn], env=env): 2836s with Client(scheduler_file=fn, loop=loop) as c: 2836s > assert ( 2836s c.run_on_scheduler(lambda dask_scheduler: dask_scheduler.foo) 2836s == "bar" 2836s ) 2836s 2836s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:413: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 2836s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 2836s return sync( 2836s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 2836s raise error 2836s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 2836s result = yield future 2836s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 2836s value = future.result() 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s function = . at 0xe63f78562840> 2836s wait = True, args = (), kwargs = {} 2836s response = {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\x8c\x12unpickle_exception\...ext': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...} 2836s typ = 2836s exc = SystemError('no locals found when setting up annotations'), tb = None 2836s 2836s async def _run_on_scheduler(self, function, *args, wait=True, **kwargs): 2836s response = await self.scheduler.run_function( 2836s function=dumps(function), 2836s args=dumps(args), 2836s kwargs=dumps(kwargs), 2836s wait=wait, 2836s ) 2836s if response["status"] == "error": 2836s typ, exc, tb = clean_exception(**response) 2836s > raise exc.with_traceback(tb) 2836s E SystemError: no locals found when setting up annotations 2836s 2836s /usr/lib/python3/dist-packages/distributed/client.py:2817: SystemError 2836s ----------------------------- Captured stderr call ----------------------------- 2836s 2024-11-24 00:28:32,542 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:28:32,544 - distributed.preloading - INFO - Creating preload: 2836s _scheduler_info = {} 2836s 2836s def dask_setup(scheduler): 2836s _scheduler_info['address'] = scheduler.address 2836s scheduler.foo = "bar" 2836s 2836s def get_scheduler_address(): 2836s return _scheduler_info['address'] 2836s 2836s 2024-11-24 00:28:32,545 - distributed.utils - INFO - Reload module tmp04pb9ubs from .py file 2836s 2024-11-24 00:28:32,545 - distributed.preloading - INFO - Import preload module: /tmp/tmp04pb9ubs.py 2836s 2024-11-24 00:28:32,561 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 2836s 2024-11-24 00:28:32,564 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:28:32,567 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:28:32,568 - distributed.scheduler - INFO - Scheduler at: tcp://10.145.243.241:8786 2836s 2024-11-24 00:28:32,568 - distributed.scheduler - INFO - dashboard at: http://10.145.243.241:8787/status 2836s 2024-11-24 00:28:32,568 - distributed.preloading - INFO - Run preload setup: 2836s _scheduler_info = {} 2836s 2836s def dask_setup(scheduler): 2836s _scheduler_info['address'] = scheduler.address 2836s scheduler.foo = "bar" 2836s 2836s def get_scheduler_address(): 2836s return _scheduler_info['address'] 2836s 2836s 2024-11-24 00:28:32,568 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:28:32,576 - distributed.scheduler - INFO - Receive client connection: Client-08c3c01a-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:28:32,807 - distributed.core - INFO - Starting established connection to tcp://10.145.243.241:40594 2836s 2024-11-24 00:28:32,811 - distributed.worker - INFO - Run out-of-band function 'lambda' 2836s 2024-11-24 00:28:32,811 - distributed.worker - WARNING - Run Failed 2836s Function: lambda 2836s args: () 2836s kwargs: {'dask_scheduler': } 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 3182, in run 2836s result = function(*args, **kwargs) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s SystemError: no locals found when setting up annotations 2836s 2024-11-24 00:28:32,821 - distributed.scheduler - INFO - Remove client Client-08c3c01a-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:28:32,821 - distributed.core - INFO - Received 'close-stream' from tcp://10.145.243.241:40594; closing. 2836s 2024-11-24 00:28:32,821 - distributed.scheduler - INFO - Remove client Client-08c3c01a-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:28:32,822 - distributed.scheduler - INFO - Close client connection: Client-08c3c01a-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:28:32,822 - distributed._signals - INFO - Received signal SIGINT (2) 2836s 2024-11-24 00:28:32,822 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 2836s 2024-11-24 00:28:32,822 - distributed.scheduler - INFO - Scheduler closing all comms 2836s 2024-11-24 00:28:32,823 - distributed.scheduler - INFO - Stopped scheduler at 'tcp://10.145.243.241:8786' 2836s 2024-11-24 00:28:32,823 - distributed.scheduler - INFO - End scheduler 2836s _____________________________ test_preload_command _____________________________ 2836s 2836s self = 2836s deserializers = None 2836s 2836s async def read(self, deserializers=None): 2836s stream = self.stream 2836s if stream is None: 2836s raise CommClosedError() 2836s 2836s fmt = "Q" 2836s fmt_size = struct.calcsize(fmt) 2836s 2836s try: 2836s # Don't store multiple numpy or parquet buffers into the same buffer, or 2836s # none will be released until all are released. 2836s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 2836s E tornado.iostream.StreamClosedError: Stream is closed 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s loop = 2836s 2836s def test_preload_command(loop): 2836s def check_passthrough(): 2836s import passthrough_info 2836s 2836s return passthrough_info.get_passthrough() 2836s 2836s tmpdir = tempfile.mkdtemp() 2836s try: 2836s path = os.path.join(tmpdir, "passthrough_info.py") 2836s with open(path, "w") as f: 2836s f.write(PRELOAD_COMMAND_TEXT) 2836s 2836s with tmpfile() as fn: 2836s print(fn) 2836s with popen( 2836s [ 2836s "dask", 2836s "scheduler", 2836s "--scheduler-file", 2836s fn, 2836s "--preload", 2836s path, 2836s "--passthrough", 2836s "foobar", 2836s ] 2836s ): 2836s with Client(scheduler_file=fn, loop=loop) as c: 2836s > assert c.run_on_scheduler(check_passthrough) == "foobar" 2836s 2836s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:460: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 2836s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 2836s return sync( 2836s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 2836s raise error 2836s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 2836s result = yield future 2836s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 2836s value = future.result() 2836s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 2836s response = await self.scheduler.run_function( 2836s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 2836s return await send_recv(comm=comm, op=key, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 2836s response = await comm.read(deserializers=deserializers) 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 2836s convert_stream_closed_error(self, e) 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s obj = 2836s exc = StreamClosedError('Stream is closed') 2836s 2836s def convert_stream_closed_error(obj, exc): 2836s """ 2836s Re-raise StreamClosedError as CommClosedError. 2836s """ 2836s if exc.real_error is not None: 2836s # The stream was closed because of an underlying OS error 2836s exc = exc.real_error 2836s if isinstance(exc, ssl.SSLError): 2836s if exc.reason and "UNKNOWN_CA" in exc.reason: 2836s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 2836s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 2836s else: 2836s > raise CommClosedError(f"in {obj}: {exc}") from exc 2836s E distributed.comm.core.CommClosedError: in : Stream is closed 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 2836s ----------------------------- Captured stdout call ----------------------------- 2836s /tmp/tmpyepk4kms 2836s ----------------------------- Captured stderr call ----------------------------- 2836s 2024-11-24 00:28:33,689 - distributed.utils - INFO - Reload module passthrough_info from .py file 2836s 2024-11-24 00:28:33,690 - distributed.preloading - INFO - Import preload module: /tmp/tmptoo4tpf2/passthrough_info.py 2836s 2024-11-24 00:28:33,691 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:28:33,693 - distributed.preloading - INFO - Creating preload: /tmp/tmptoo4tpf2/passthrough_info.py 2836s 2024-11-24 00:28:33,693 - distributed.utils - INFO - Reload module passthrough_info from .py file 2836s 2024-11-24 00:28:33,693 - distributed.preloading - INFO - Import preload module: /tmp/tmptoo4tpf2/passthrough_info.py 2836s 2024-11-24 00:28:33,709 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 2836s 2024-11-24 00:28:33,711 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:28:33,715 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:28:33,716 - distributed.scheduler - INFO - Scheduler at: tcp://10.145.243.241:8786 2836s 2024-11-24 00:28:33,716 - distributed.scheduler - INFO - dashboard at: http://10.145.243.241:8787/status 2836s 2024-11-24 00:28:33,716 - distributed.preloading - INFO - Run preload setup: /tmp/tmptoo4tpf2/passthrough_info.py 2836s 2024-11-24 00:28:33,717 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:28:33,727 - distributed.scheduler - INFO - Receive client connection: Client-097100fd-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:28:33,955 - distributed.core - INFO - Starting established connection to tcp://10.145.243.241:40614 2836s 2024-11-24 00:28:33,958 - distributed.worker - INFO - Run out-of-band function 'check_passthrough' 2836s 2024-11-24 00:28:34,219 - distributed.client - ERROR - 2836s ConnectionRefusedError: [Errno 111] Connection refused 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 2836s convert_stream_closed_error(self, e) 2836s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 2836s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 2836s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 2836s 2836s During handling of the above exception, another exception occurred: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 2836s return await func(*args, **kwargs) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 2836s await self._ensure_connected(timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 2836s comm = await connect( 2836s ^^^^^^^^^^^^^^ 2836s self.scheduler.address, timeout=timeout, **self.connection_args 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 2836s await asyncio.sleep(backoff) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2836s return await future 2836s ^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s _________________________ test_preload_command_default _________________________ 2836s 2836s self = 2836s deserializers = None 2836s 2836s async def read(self, deserializers=None): 2836s stream = self.stream 2836s if stream is None: 2836s raise CommClosedError() 2836s 2836s fmt = "Q" 2836s fmt_size = struct.calcsize(fmt) 2836s 2836s try: 2836s # Don't store multiple numpy or parquet buffers into the same buffer, or 2836s # none will be released until all are released. 2836s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 2836s E tornado.iostream.StreamClosedError: Stream is closed 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s loop = 2836s 2836s def test_preload_command_default(loop): 2836s def check_passthrough(): 2836s import passthrough_info 2836s 2836s return passthrough_info.get_passthrough() 2836s 2836s tmpdir = tempfile.mkdtemp() 2836s try: 2836s path = os.path.join(tmpdir, "passthrough_info.py") 2836s with open(path, "w") as f: 2836s f.write(PRELOAD_COMMAND_TEXT) 2836s 2836s with tmpfile() as fn2: 2836s print(fn2) 2836s with popen( 2836s ["dask", "scheduler", "--scheduler-file", fn2, "--preload", path], 2836s stdout=sys.stdout, 2836s stderr=sys.stderr, 2836s ): 2836s with Client(scheduler_file=fn2, loop=loop) as c: 2836s > assert c.run_on_scheduler(check_passthrough) == "default" 2836s 2836s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:485: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 2836s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 2836s return sync( 2836s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 2836s raise error 2836s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 2836s result = yield future 2836s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 2836s value = future.result() 2836s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 2836s response = await self.scheduler.run_function( 2836s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 2836s return await send_recv(comm=comm, op=key, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 2836s response = await comm.read(deserializers=deserializers) 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 2836s convert_stream_closed_error(self, e) 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s obj = 2836s exc = StreamClosedError('Stream is closed') 2836s 2836s def convert_stream_closed_error(obj, exc): 2836s """ 2836s Re-raise StreamClosedError as CommClosedError. 2836s """ 2836s if exc.real_error is not None: 2836s # The stream was closed because of an underlying OS error 2836s exc = exc.real_error 2836s if isinstance(exc, ssl.SSLError): 2836s if exc.reason and "UNKNOWN_CA" in exc.reason: 2836s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 2836s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 2836s else: 2836s > raise CommClosedError(f"in {obj}: {exc}") from exc 2836s E distributed.comm.core.CommClosedError: in : Stream is closed 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 2836s ----------------------------- Captured stdout call ----------------------------- 2836s /tmp/tmpjrldxjpq 2836s ----------------------------- Captured stderr call ----------------------------- 2836s 2024-11-24 00:28:34,949 - distributed.utils - INFO - Reload module passthrough_info from .py file 2836s 2024-11-24 00:28:34,950 - distributed.preloading - INFO - Import preload module: /tmp/tmp08qwq70r/passthrough_info.py 2836s 2024-11-24 00:28:34,951 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:28:34,952 - distributed.preloading - INFO - Creating preload: /tmp/tmp08qwq70r/passthrough_info.py 2836s 2024-11-24 00:28:34,952 - distributed.utils - INFO - Reload module passthrough_info from .py file 2836s 2024-11-24 00:28:34,953 - distributed.preloading - INFO - Import preload module: /tmp/tmp08qwq70r/passthrough_info.py 2836s 2024-11-24 00:28:34,968 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 2836s 2024-11-24 00:28:34,970 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:28:34,971 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-4h04q9wb', purging 2836s 2024-11-24 00:28:34,974 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:28:34,974 - distributed.scheduler - INFO - Scheduler at: tcp://10.145.243.241:8786 2836s 2024-11-24 00:28:34,975 - distributed.scheduler - INFO - dashboard at: http://10.145.243.241:8787/status 2836s 2024-11-24 00:28:34,975 - distributed.preloading - INFO - Run preload setup: /tmp/tmp08qwq70r/passthrough_info.py 2836s 2024-11-24 00:28:34,975 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:28:34,980 - distributed.scheduler - INFO - Receive client connection: Client-0a31ebfa-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:28:35,210 - distributed.core - INFO - Starting established connection to tcp://10.145.243.241:40690 2836s 2024-11-24 00:28:35,212 - distributed.worker - INFO - Run out-of-band function 'check_passthrough' 2836s 2024-11-24 00:28:35,471 - distributed.client - ERROR - 2836s ConnectionRefusedError: [Errno 111] Connection refused 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 2836s convert_stream_closed_error(self, e) 2836s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 2836s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 2836s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 2836s 2836s During handling of the above exception, another exception occurred: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 2836s return await func(*args, **kwargs) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 2836s await self._ensure_connected(timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 2836s comm = await connect( 2836s ^^^^^^^^^^^^^^ 2836s self.scheduler.address, timeout=timeout, **self.connection_args 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 2836s await asyncio.sleep(backoff) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2836s return await future 2836s ^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s ___________________________ test_multiple_workers_2 ____________________________ 2836s 2836s loop = 2836s 2836s def test_multiple_workers_2(loop): 2836s text = """ 2836s def dask_setup(worker): 2836s worker.foo = 'setup' 2836s """ 2836s port = open_port() 2836s with popen( 2836s ["dask", "scheduler", "--no-dashboard", "--host", f"127.0.0.1:{port}"] 2836s ) as s: 2836s with popen( 2836s [ 2836s "dask", 2836s "worker", 2836s f"localhost:{port}", 2836s "--no-dashboard", 2836s "--preload", 2836s text, 2836s "--preload-nanny", 2836s text, 2836s ] 2836s ) as a: 2836s with Client(f"127.0.0.1:{port}", loop=loop) as c: 2836s c.wait_for_workers(1) 2836s > [foo] = c.run(lambda dask_worker: dask_worker.foo).values() 2836s 2836s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:549: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/client.py:2993: in run 2836s return self.sync( 2836s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 2836s return sync( 2836s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 2836s raise error 2836s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 2836s result = yield future 2836s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 2836s value = future.result() 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s function = . at 0xe63f785622a0> 2836s nanny = False, workers = None, wait = True, on_error = 'raise', args = () 2836s kwargs = {} 2836s responses = {'tcp://127.0.0.1:35709': {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\...xt': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...}} 2836s results = {}, key = 'tcp://127.0.0.1:35709' 2836s resp = {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\x8c\x12unpickle_exception\...ext': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...} 2836s exc = SystemError('no locals found when setting up annotations') 2836s _ = 2836s 2836s async def _run( 2836s self, 2836s function, 2836s *args, 2836s nanny: bool = False, 2836s workers: list[str] | None = None, 2836s wait: bool = True, 2836s on_error: Literal["raise", "return", "ignore"] = "raise", 2836s **kwargs, 2836s ): 2836s responses = await self.scheduler.broadcast( 2836s msg=dict( 2836s op="run", 2836s function=dumps(function), 2836s args=dumps(args), 2836s wait=wait, 2836s kwargs=dumps(kwargs), 2836s ), 2836s workers=workers, 2836s nanny=nanny, 2836s on_error="return_pickle", 2836s ) 2836s results = {} 2836s for key, resp in responses.items(): 2836s if isinstance(resp, bytes): 2836s # Pickled RPC exception 2836s exc = loads(resp) 2836s assert isinstance(exc, Exception) 2836s elif resp["status"] == "error": 2836s # Exception raised by the remote function 2836s _, exc, tb = clean_exception(**resp) 2836s exc = exc.with_traceback(tb) 2836s else: 2836s assert resp["status"] == "OK" 2836s results[key] = resp["result"] 2836s continue 2836s 2836s if on_error == "raise": 2836s > raise exc 2836s E SystemError: no locals found when setting up annotations 2836s 2836s /usr/lib/python3/dist-packages/distributed/client.py:2898: SystemError 2836s ----------------------------- Captured stderr call ----------------------------- 2836s 2024-11-24 00:28:36,306 - distributed.utils - INFO - Reload module tmpiuau02o1 from .py file 2836s 2024-11-24 00:28:36,306 - distributed.preloading - INFO - Import preload module: /tmp/tmpiuau02o1.py 2836s 2024-11-24 00:28:36,312 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:28:36,312 - distributed.preloading - INFO - Creating preload: 2836s def dask_setup(worker): 2836s worker.foo = 'setup' 2836s 2836s 2024-11-24 00:28:36,312 - distributed.utils - INFO - Reload module tmppxkrho_w from .py file 2836s 2024-11-24 00:28:36,313 - distributed.preloading - INFO - Import preload module: /tmp/tmppxkrho_w.py 2836s 2024-11-24 00:28:36,314 - distributed.preloading - INFO - Run preload setup: 2836s def dask_setup(worker): 2836s worker.foo = 'setup' 2836s 2836s 2024-11-24 00:28:36,327 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 2836s 2024-11-24 00:28:36,330 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:28:36,331 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-b0rwnx_5', purging 2836s 2024-11-24 00:28:36,334 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:28:36,334 - distributed.scheduler - INFO - Scheduler at: tcp://127.0.0.1:35667 2836s 2024-11-24 00:28:36,334 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:8787/status 2836s 2024-11-24 00:28:36,335 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:28:36,339 - distributed.nanny - INFO - Start Nanny at: 'tcp://127.0.0.1:44095' 2836s 2024-11-24 00:28:36,584 - distributed.scheduler - INFO - Receive client connection: Client-0aff3d30-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:28:36,826 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:45770 2836s 2024-11-24 00:28:36,842 - distributed.preloading - INFO - Creating preload: 2836s def dask_setup(worker): 2836s worker.foo = 'setup' 2836s 2836s 2024-11-24 00:28:36,843 - distributed.utils - INFO - Reload module tmpmpca4fvw from .py file 2836s 2024-11-24 00:28:36,844 - distributed.preloading - INFO - Import preload module: /tmp/tmpmpca4fvw.py 2836s 2024-11-24 00:28:36,862 - distributed.preloading - INFO - Run preload setup: 2836s def dask_setup(worker): 2836s worker.foo = 'setup' 2836s 2836s 2024-11-24 00:28:36,862 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:35709 2836s 2024-11-24 00:28:36,862 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:35709 2836s 2024-11-24 00:28:36,862 - distributed.worker - INFO - dashboard at: 127.0.0.1:44115 2836s 2024-11-24 00:28:36,862 - distributed.worker - INFO - Waiting to connect to: tcp://localhost:35667 2836s 2024-11-24 00:28:36,862 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:28:36,862 - distributed.worker - INFO - Threads: 4 2836s 2024-11-24 00:28:36,862 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:28:36,862 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e8fyh5oq 2836s 2024-11-24 00:28:36,862 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:28:37,091 - distributed.scheduler - INFO - Register worker 2836s 2024-11-24 00:28:37,092 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:35709 2836s 2024-11-24 00:28:37,092 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:45798 2836s 2024-11-24 00:28:37,092 - distributed.worker - INFO - Starting Worker plugin shuffle 2836s 2024-11-24 00:28:37,093 - distributed.worker - INFO - Registered to: tcp://localhost:35667 2836s 2024-11-24 00:28:37,093 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:28:37,093 - distributed.core - INFO - Starting established connection to tcp://localhost:35667 2836s 2024-11-24 00:28:37,136 - distributed.worker - INFO - Run out-of-band function 'lambda' 2836s 2024-11-24 00:28:37,136 - distributed.worker - WARNING - Run Failed 2836s Function: lambda 2836s args: () 2836s kwargs: {'dask_worker': } 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 3182, in run 2836s result = function(*args, **kwargs) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s SystemError: no locals found when setting up annotations 2836s 2024-11-24 00:28:37,140 - distributed.scheduler - INFO - Remove client Client-0aff3d30-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:28:37,141 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:45770; closing. 2836s 2024-11-24 00:28:37,141 - distributed.scheduler - INFO - Remove client Client-0aff3d30-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:28:37,141 - distributed.scheduler - INFO - Close client connection: Client-0aff3d30-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:28:37,141 - distributed._signals - INFO - Received signal SIGINT (2) 2836s 2024-11-24 00:28:37,142 - distributed.nanny - INFO - Closing Nanny at 'tcp://127.0.0.1:44095'. Reason: signal-2 2836s 2024-11-24 00:28:37,142 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 2836s 2024-11-24 00:28:37,142 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:35709. Reason: signal-2 2836s 2024-11-24 00:28:37,144 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:45798; closing. 2836s 2024-11-24 00:28:37,144 - distributed.core - INFO - Connection to tcp://localhost:35667 has been closed. 2836s 2024-11-24 00:28:37,144 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732408117.1442618') 2836s 2024-11-24 00:28:37,144 - distributed.scheduler - INFO - Lost all workers 2836s 2024-11-24 00:28:37,145 - distributed.nanny - INFO - Worker closed 2836s 2024-11-24 00:28:37,357 - distributed.dask_worker - INFO - End worker 2836s 2024-11-24 00:28:37,507 - distributed._signals - INFO - Received signal SIGINT (2) 2836s 2024-11-24 00:28:37,507 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 2836s 2024-11-24 00:28:37,508 - distributed.scheduler - INFO - Scheduler closing all comms 2836s 2024-11-24 00:28:37,508 - distributed.scheduler - INFO - Stopped scheduler at 'tcp://127.0.0.1:35667' 2836s 2024-11-24 00:28:37,508 - distributed.scheduler - INFO - End scheduler 2836s __________________________________ test_basic __________________________________ 2836s 2836s self = 2836s address = '127.0.0.1:8786', deserialize = True 2836s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 2836s ip = '127.0.0.1', port = 8786 2836s kwargs = {'ssl_options': } 2836s 2836s async def connect(self, address, deserialize=True, **connection_args): 2836s self._check_encryption(address, connection_args) 2836s ip, port = parse_host_port(address) 2836s kwargs = self._get_connect_args(**connection_args) 2836s 2836s try: 2836s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 2836s if "server_hostname" in kwargs: 2836s stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE 2836s ) 2836s stream = await stream.start_tls(False, **kwargs) 2836s else: 2836s > stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ) 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 2836s stream = await stream.start_tls( 2836s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 2836s self.socket.do_handshake() 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = , block = False 2836s 2836s @_sslcopydoc 2836s def do_handshake(self, block=False): 2836s self._check_connected() 2836s timeout = self.gettimeout() 2836s try: 2836s if timeout == 0.0 and block: 2836s self.settimeout(None) 2836s > self._sslobj.do_handshake() 2836s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2836s 2836s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s loop = 2836s requires_default_ports = None 2836s 2836s def test_basic(loop, requires_default_ports): 2836s with ( 2836s popen(["dask", "scheduler", "--no-dashboard"] + tls_args), 2836s popen(["dask", "worker", "--no-dashboard", "tls://127.0.0.1:8786"] + tls_args), 2836s > Client("tls://127.0.0.1:8786", loop=loop, security=tls_security()) as c, 2836s ): 2836s 2836s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:37: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 2836s self.start(timeout=timeout) 2836s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 2836s sync(self.loop, self._start, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 2836s raise error 2836s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 2836s result = yield future 2836s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 2836s value = future.result() 2836s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 2836s await self._ensure_connected(timeout=timeout) 2836s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 2836s comm = await connect( 2836s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2836s comm = await wait_for( 2836s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2836s return await fut 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s address = '127.0.0.1:8786', deserialize = True 2836s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 2836s ip = '127.0.0.1', port = 8786 2836s kwargs = {'ssl_options': } 2836s 2836s async def connect(self, address, deserialize=True, **connection_args): 2836s self._check_encryption(address, connection_args) 2836s ip, port = parse_host_port(address) 2836s kwargs = self._get_connect_args(**connection_args) 2836s 2836s try: 2836s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 2836s if "server_hostname" in kwargs: 2836s stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE 2836s ) 2836s stream = await stream.start_tls(False, **kwargs) 2836s else: 2836s stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ) 2836s 2836s # Under certain circumstances tornado will have a closed connection with an 2836s # error and not raise a StreamClosedError. 2836s # 2836s # This occurs with tornado 5.x and openssl 1.1+ 2836s if stream.closed() and stream.error: 2836s raise StreamClosedError(stream.error) 2836s 2836s except StreamClosedError as e: 2836s # The socket connect() call failed 2836s convert_stream_closed_error(self, e) 2836s except SSLCertVerificationError as err: 2836s > raise FatalCommClosedError( 2836s "TLS certificate does not match. Check your security settings. " 2836s "More info at https://distributed.dask.org/en/latest/tls.html" 2836s ) from err 2836s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 2836s ----------------------------- Captured stderr call ----------------------------- 2836s 2024-11-24 00:29:11,891 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:29:11,908 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 2836s 2024-11-24 00:29:11,910 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:29:11,914 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:29:11,915 - distributed.scheduler - INFO - Scheduler at: tls://10.145.243.241:8786 2836s 2024-11-24 00:29:11,916 - distributed.scheduler - INFO - dashboard at: http://10.145.243.241:8787/status 2836s 2024-11-24 00:29:11,916 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:29:11,941 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:35309' 2836s 2024-11-24 00:29:12,222 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:8786': TLS handshake failed with remote 'tls://127.0.0.1:55934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 2836s 2024-11-24 00:29:12,223 - distributed._signals - INFO - Received signal SIGINT (2) 2836s 2024-11-24 00:29:12,223 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35309'. Reason: signal-2 2836s 2024-11-24 00:29:12,454 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44621 2836s 2024-11-24 00:29:12,454 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44621 2836s 2024-11-24 00:29:12,454 - distributed.worker - INFO - dashboard at: 127.0.0.1:40109 2836s 2024-11-24 00:29:12,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:8786 2836s 2024-11-24 00:29:12,454 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:29:12,454 - distributed.worker - INFO - Threads: 4 2836s 2024-11-24 00:29:12,454 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:29:12,454 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c_kxn1qx 2836s 2024-11-24 00:29:12,454 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:29:12,695 - distributed.scheduler - INFO - Register worker 2836s 2024-11-24 00:29:12,939 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:44621 2836s 2024-11-24 00:29:12,940 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:55938 2836s 2024-11-24 00:29:12,940 - distributed.worker - INFO - Starting Worker plugin shuffle 2836s 2024-11-24 00:29:12,940 - distributed.worker - INFO - Registered to: tls://127.0.0.1:8786 2836s 2024-11-24 00:29:12,941 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:29:12,942 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:8786 2836s 2024-11-24 00:29:12,952 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 2836s 2024-11-24 00:29:12,953 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44621. Reason: signal-2 2836s 2024-11-24 00:29:12,954 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:55938; closing. 2836s 2024-11-24 00:29:12,955 - distributed.core - INFO - Connection to tls://127.0.0.1:8786 has been closed. 2836s 2024-11-24 00:29:12,955 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732408152.9553008') 2836s 2024-11-24 00:29:12,955 - distributed.scheduler - INFO - Lost all workers 2836s 2024-11-24 00:29:12,956 - distributed.nanny - INFO - Worker closed 2836s 2024-11-24 00:29:13,183 - distributed.dask_worker - INFO - End worker 2836s 2024-11-24 00:29:13,340 - distributed._signals - INFO - Received signal SIGINT (2) 2836s 2024-11-24 00:29:13,340 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 2836s 2024-11-24 00:29:13,340 - distributed.scheduler - INFO - Scheduler closing all comms 2836s 2024-11-24 00:29:13,341 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.145.243.241:8786' 2836s 2024-11-24 00:29:13,341 - distributed.scheduler - INFO - End scheduler 2836s ___________________________________ test_sni ___________________________________ 2836s 2836s self = 2836s address = '127.0.0.1:56525', deserialize = True 2836s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 2836s ip = '127.0.0.1', port = 56525 2836s kwargs = {'ssl_options': } 2836s 2836s async def connect(self, address, deserialize=True, **connection_args): 2836s self._check_encryption(address, connection_args) 2836s ip, port = parse_host_port(address) 2836s kwargs = self._get_connect_args(**connection_args) 2836s 2836s try: 2836s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 2836s if "server_hostname" in kwargs: 2836s stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE 2836s ) 2836s stream = await stream.start_tls(False, **kwargs) 2836s else: 2836s > stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ) 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 2836s stream = await stream.start_tls( 2836s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 2836s self.socket.do_handshake() 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = , block = False 2836s 2836s @_sslcopydoc 2836s def do_handshake(self, block=False): 2836s self._check_connected() 2836s timeout = self.gettimeout() 2836s try: 2836s if timeout == 0.0 and block: 2836s self.settimeout(None) 2836s > self._sslobj.do_handshake() 2836s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2836s 2836s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s loop = 2836s 2836s def test_sni(loop): 2836s port = open_port() 2836s with popen( 2836s ["dask", "scheduler", "--no-dashboard", f"--port={port}"] + tls_args 2836s ) as s: 2836s with popen( 2836s [ 2836s "dask", 2836s "worker", 2836s "--no-dashboard", 2836s "--scheduler-sni", 2836s "localhost", 2836s f"tls://127.0.0.1:{port}", 2836s ] 2836s + tls_args 2836s ) as w: 2836s > with Client( 2836s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 2836s ) as c: 2836s 2836s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:58: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 2836s self.start(timeout=timeout) 2836s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 2836s sync(self.loop, self._start, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 2836s raise error 2836s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 2836s result = yield future 2836s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 2836s value = future.result() 2836s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 2836s await self._ensure_connected(timeout=timeout) 2836s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 2836s comm = await connect( 2836s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2836s comm = await wait_for( 2836s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2836s return await fut 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s address = '127.0.0.1:56525', deserialize = True 2836s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 2836s ip = '127.0.0.1', port = 56525 2836s kwargs = {'ssl_options': } 2836s 2836s async def connect(self, address, deserialize=True, **connection_args): 2836s self._check_encryption(address, connection_args) 2836s ip, port = parse_host_port(address) 2836s kwargs = self._get_connect_args(**connection_args) 2836s 2836s try: 2836s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 2836s if "server_hostname" in kwargs: 2836s stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE 2836s ) 2836s stream = await stream.start_tls(False, **kwargs) 2836s else: 2836s stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ) 2836s 2836s # Under certain circumstances tornado will have a closed connection with an 2836s # error and not raise a StreamClosedError. 2836s # 2836s # This occurs with tornado 5.x and openssl 1.1+ 2836s if stream.closed() and stream.error: 2836s raise StreamClosedError(stream.error) 2836s 2836s except StreamClosedError as e: 2836s # The socket connect() call failed 2836s convert_stream_closed_error(self, e) 2836s except SSLCertVerificationError as err: 2836s > raise FatalCommClosedError( 2836s "TLS certificate does not match. Check your security settings. " 2836s "More info at https://distributed.dask.org/en/latest/tls.html" 2836s ) from err 2836s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 2836s ----------------------------- Captured stderr call ----------------------------- 2836s 2024-11-24 00:29:14,435 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:29:14,452 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 2836s 2024-11-24 00:29:14,455 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:29:14,458 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:29:14,460 - distributed.scheduler - INFO - Scheduler at: tls://10.145.243.241:56525 2836s 2024-11-24 00:29:14,460 - distributed.scheduler - INFO - dashboard at: http://10.145.243.241:8787/status 2836s 2024-11-24 00:29:14,460 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:29:14,666 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:56525': TLS handshake failed with remote 'tls://127.0.0.1:33274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 2836s Traceback (most recent call last): 2836s File "/usr/bin/dask", line 8, in 2836s sys.exit(main()) 2836s ^^^^^^ 2836s File "/usr/lib/python3/dist-packages/dask/__main__.py", line 7, in main 2836s run_cli() 2836s File "/usr/lib/python3/dist-packages/dask/cli.py", line 207, in run_cli 2836s _register_command_ep(cli, ep) 2836s File "/usr/lib/python3/dist-packages/dask/cli.py", line 178, in _register_command_ep 2836s command = entry_point.load() 2836s ^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3.12/importlib/metadata/__init__.py", line 205, in load 2836s module = import_module(match.group('module')) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3.12/importlib/__init__.py", line 90, in import_module 2836s return _bootstrap._gcd_import(name[level:], package, level) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "", line 1387, in _gcd_import 2836s File "", line 1360, in _find_and_load 2836s File "", line 1310, in _find_and_load_unlocked 2836s File "", line 488, in _call_with_frames_removed 2836s File "", line 1387, in _gcd_import 2836s File "", line 1360, in _find_and_load 2836s File "", line 1310, in _find_and_load_unlocked 2836s File "", line 488, in _call_with_frames_removed 2836s File "", line 1387, in _gcd_import 2836s File "", line 1360, in _find_and_load 2836s File "", line 1331, in _find_and_load_unlocked 2836s File "", line 935, in _load_unlocked 2836s File "", line 995, in exec_module 2836s File "", line 488, in _call_with_frames_removed 2836s File "/usr/lib/python3/dist-packages/distributed/__init__.py", line 23, in 2836s from distributed.actor import Actor, ActorFuture, BaseActorFuture 2836s File "/usr/lib/python3/dist-packages/distributed/actor.py", line 13, in 2836s from distributed.client import Future 2836s File "/usr/lib/python3/dist-packages/distributed/client.py", line 52, in 2836s from distributed.core import OKMessage 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 36, in 2836s from distributed import profile, protocol 2836s File "/usr/lib/python3/dist-packages/distributed/protocol/__init__.py", line 6, in 2836s from distributed.protocol.core import decompress, dumps, loads, maybe_compress, msgpack 2836s File "/usr/lib/python3/dist-packages/distributed/protocol/core.py", line 7, in 2836s from distributed.protocol import pickle 2836s File "/usr/lib/python3/dist-packages/distributed/protocol/pickle.py", line 11, in 2836s from distributed.protocol.serialize import dask_deserialize, dask_serialize 2836s File "/usr/lib/python3/dist-packages/distributed/protocol/serialize.py", line 24, in 2836s from distributed.protocol.utils import ( 2836s File "/usr/lib/python3/dist-packages/distributed/protocol/utils.py", line 26, in 2836s import numpy 2836s File "/usr/lib/python3/dist-packages/numpy/__init__.py", line 426, in 2836s kernel_version = tuple(int(v) for v in kernel_version) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/numpy/__init__.py", line 426, in 2836s kernel_version = tuple(int(v) for v in kernel_version) 2836s 2836s KeyboardInterrupt 2836s 2024-11-24 00:29:15,031 - distributed._signals - INFO - Received signal SIGINT (2) 2836s 2024-11-24 00:29:15,031 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 2836s 2024-11-24 00:29:15,031 - distributed.scheduler - INFO - Scheduler closing all comms 2836s 2024-11-24 00:29:15,032 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.145.243.241:56525' 2836s 2024-11-24 00:29:15,032 - distributed.scheduler - INFO - End scheduler 2836s __________________________________ test_nanny __________________________________ 2836s 2836s self = 2836s address = '127.0.0.1:54737', deserialize = True 2836s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 2836s ip = '127.0.0.1', port = 54737 2836s kwargs = {'ssl_options': } 2836s 2836s async def connect(self, address, deserialize=True, **connection_args): 2836s self._check_encryption(address, connection_args) 2836s ip, port = parse_host_port(address) 2836s kwargs = self._get_connect_args(**connection_args) 2836s 2836s try: 2836s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 2836s if "server_hostname" in kwargs: 2836s stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE 2836s ) 2836s stream = await stream.start_tls(False, **kwargs) 2836s else: 2836s > stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ) 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 2836s stream = await stream.start_tls( 2836s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 2836s self.socket.do_handshake() 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = , block = False 2836s 2836s @_sslcopydoc 2836s def do_handshake(self, block=False): 2836s self._check_connected() 2836s timeout = self.gettimeout() 2836s try: 2836s if timeout == 0.0 and block: 2836s self.settimeout(None) 2836s > self._sslobj.do_handshake() 2836s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2836s 2836s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s loop = 2836s 2836s def test_nanny(loop): 2836s port = open_port() 2836s with popen( 2836s [ 2836s "dask", 2836s "scheduler", 2836s "--no-dashboard", 2836s f"--port={port}", 2836s ] 2836s + tls_args 2836s ) as s: 2836s with popen( 2836s ["dask", "worker", "--no-dashboard", "--nanny", f"tls://127.0.0.1:{port}"] 2836s + tls_args 2836s ) as w: 2836s > with Client( 2836s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 2836s ) as c: 2836s 2836s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:79: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 2836s self.start(timeout=timeout) 2836s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 2836s sync(self.loop, self._start, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 2836s raise error 2836s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 2836s result = yield future 2836s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 2836s value = future.result() 2836s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 2836s await self._ensure_connected(timeout=timeout) 2836s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 2836s comm = await connect( 2836s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2836s comm = await wait_for( 2836s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2836s return await fut 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s address = '127.0.0.1:54737', deserialize = True 2836s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 2836s ip = '127.0.0.1', port = 54737 2836s kwargs = {'ssl_options': } 2836s 2836s async def connect(self, address, deserialize=True, **connection_args): 2836s self._check_encryption(address, connection_args) 2836s ip, port = parse_host_port(address) 2836s kwargs = self._get_connect_args(**connection_args) 2836s 2836s try: 2836s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 2836s if "server_hostname" in kwargs: 2836s stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE 2836s ) 2836s stream = await stream.start_tls(False, **kwargs) 2836s else: 2836s stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ) 2836s 2836s # Under certain circumstances tornado will have a closed connection with an 2836s # error and not raise a StreamClosedError. 2836s # 2836s # This occurs with tornado 5.x and openssl 1.1+ 2836s if stream.closed() and stream.error: 2836s raise StreamClosedError(stream.error) 2836s 2836s except StreamClosedError as e: 2836s # The socket connect() call failed 2836s convert_stream_closed_error(self, e) 2836s except SSLCertVerificationError as err: 2836s > raise FatalCommClosedError( 2836s "TLS certificate does not match. Check your security settings. " 2836s "More info at https://distributed.dask.org/en/latest/tls.html" 2836s ) from err 2836s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 2836s ----------------------------- Captured stderr call ----------------------------- 2836s 2024-11-24 00:29:16,634 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:29:16,677 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 2836s 2024-11-24 00:29:16,682 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:29:16,692 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:29:16,697 - distributed.scheduler - INFO - Scheduler at: tls://10.145.243.241:54737 2836s 2024-11-24 00:29:16,698 - distributed.scheduler - INFO - dashboard at: http://10.145.243.241:8787/status 2836s 2024-11-24 00:29:16,698 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:29:16,865 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:41513' 2836s 2024-11-24 00:29:17,224 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:54737': TLS handshake failed with remote 'tls://127.0.0.1:41458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 2836s 2024-11-24 00:29:17,225 - distributed._signals - INFO - Received signal SIGINT (2) 2836s 2024-11-24 00:29:17,226 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41513'. Reason: signal-2 2836s 2024-11-24 00:29:17,384 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34551 2836s 2024-11-24 00:29:17,384 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34551 2836s 2024-11-24 00:29:17,384 - distributed.worker - INFO - dashboard at: 127.0.0.1:46405 2836s 2024-11-24 00:29:17,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:54737 2836s 2024-11-24 00:29:17,384 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:29:17,384 - distributed.worker - INFO - Threads: 4 2836s 2024-11-24 00:29:17,384 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:29:17,384 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6h8lwkqg 2836s 2024-11-24 00:29:17,384 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:29:17,634 - distributed.scheduler - INFO - Register worker 2836s 2024-11-24 00:29:18,215 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:34551 2836s 2024-11-24 00:29:18,216 - distributed.worker - INFO - Starting Worker plugin shuffle 2836s 2024-11-24 00:29:18,216 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:41470 2836s 2024-11-24 00:29:18,216 - distributed.worker - INFO - Registered to: tls://127.0.0.1:54737 2836s 2024-11-24 00:29:18,217 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:29:18,217 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:54737 2836s 2024-11-24 00:29:18,235 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 2836s 2024-11-24 00:29:18,236 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34551. Reason: signal-2 2836s 2024-11-24 00:29:18,237 - distributed.core - INFO - Connection to tls://127.0.0.1:54737 has been closed. 2836s 2024-11-24 00:29:18,238 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:41470; closing. 2836s 2024-11-24 00:29:18,238 - distributed.nanny - INFO - Worker closed 2836s 2024-11-24 00:29:18,239 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732408158.2394705') 2836s 2024-11-24 00:29:18,240 - distributed.scheduler - INFO - Lost all workers 2836s 2024-11-24 00:29:18,462 - distributed.dask_worker - INFO - End worker 2836s 2024-11-24 00:29:18,642 - distributed._signals - INFO - Received signal SIGINT (2) 2836s 2024-11-24 00:29:18,643 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 2836s 2024-11-24 00:29:18,644 - distributed.scheduler - INFO - Scheduler closing all comms 2836s 2024-11-24 00:29:18,645 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.145.243.241:54737' 2836s 2024-11-24 00:29:18,646 - distributed.scheduler - INFO - End scheduler 2836s ____________________________ test_separate_key_cert ____________________________ 2836s 2836s self = 2836s address = '127.0.0.1:39709', deserialize = True 2836s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 2836s ip = '127.0.0.1', port = 39709 2836s kwargs = {'ssl_options': } 2836s 2836s async def connect(self, address, deserialize=True, **connection_args): 2836s self._check_encryption(address, connection_args) 2836s ip, port = parse_host_port(address) 2836s kwargs = self._get_connect_args(**connection_args) 2836s 2836s try: 2836s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 2836s if "server_hostname" in kwargs: 2836s stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE 2836s ) 2836s stream = await stream.start_tls(False, **kwargs) 2836s else: 2836s > stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ) 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 2836s stream = await stream.start_tls( 2836s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 2836s self.socket.do_handshake() 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = , block = False 2836s 2836s @_sslcopydoc 2836s def do_handshake(self, block=False): 2836s self._check_connected() 2836s timeout = self.gettimeout() 2836s try: 2836s if timeout == 0.0 and block: 2836s self.settimeout(None) 2836s > self._sslobj.do_handshake() 2836s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2836s 2836s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s loop = 2836s 2836s def test_separate_key_cert(loop): 2836s port = open_port() 2836s with popen( 2836s [ 2836s "dask", 2836s "scheduler", 2836s "--no-dashboard", 2836s f"--port={port}", 2836s ] 2836s + tls_args_2 2836s ) as s: 2836s with popen( 2836s ["dask", "worker", "--no-dashboard", f"tls://127.0.0.1:{port}"] + tls_args_2 2836s ) as w: 2836s > with Client( 2836s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 2836s ) as c: 2836s 2836s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:99: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 2836s self.start(timeout=timeout) 2836s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 2836s sync(self.loop, self._start, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 2836s raise error 2836s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 2836s result = yield future 2836s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 2836s value = future.result() 2836s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 2836s await self._ensure_connected(timeout=timeout) 2836s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 2836s comm = await connect( 2836s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2836s comm = await wait_for( 2836s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2836s return await fut 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s address = '127.0.0.1:39709', deserialize = True 2836s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 2836s ip = '127.0.0.1', port = 39709 2836s kwargs = {'ssl_options': } 2836s 2836s async def connect(self, address, deserialize=True, **connection_args): 2836s self._check_encryption(address, connection_args) 2836s ip, port = parse_host_port(address) 2836s kwargs = self._get_connect_args(**connection_args) 2836s 2836s try: 2836s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 2836s if "server_hostname" in kwargs: 2836s stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE 2836s ) 2836s stream = await stream.start_tls(False, **kwargs) 2836s else: 2836s stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ) 2836s 2836s # Under certain circumstances tornado will have a closed connection with an 2836s # error and not raise a StreamClosedError. 2836s # 2836s # This occurs with tornado 5.x and openssl 1.1+ 2836s if stream.closed() and stream.error: 2836s raise StreamClosedError(stream.error) 2836s 2836s except StreamClosedError as e: 2836s # The socket connect() call failed 2836s convert_stream_closed_error(self, e) 2836s except SSLCertVerificationError as err: 2836s > raise FatalCommClosedError( 2836s "TLS certificate does not match. Check your security settings. " 2836s "More info at https://distributed.dask.org/en/latest/tls.html" 2836s ) from err 2836s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 2836s ----------------------------- Captured stderr call ----------------------------- 2836s 2024-11-24 00:29:20,155 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:29:20,172 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 2836s 2024-11-24 00:29:20,175 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:29:20,178 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:29:20,180 - distributed.scheduler - INFO - Scheduler at: tls://10.145.243.241:39709 2836s 2024-11-24 00:29:20,180 - distributed.scheduler - INFO - dashboard at: http://10.145.243.241:8787/status 2836s 2024-11-24 00:29:20,180 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:29:20,287 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:39709': TLS handshake failed with remote 'tls://127.0.0.1:49810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 2836s Traceback (most recent call last): 2836s File "/usr/bin/dask", line 8, in 2836s sys.exit(main()) 2836s ^^^^^^ 2836s File "/usr/lib/python3/dist-packages/dask/__main__.py", line 7, in main 2836s run_cli() 2836s File "/usr/lib/python3/dist-packages/dask/cli.py", line 207, in run_cli 2836s _register_command_ep(cli, ep) 2836s File "/usr/lib/python3/dist-packages/dask/cli.py", line 178, in _register_command_ep 2836s command = entry_point.load() 2836s ^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3.12/importlib/metadata/__init__.py", line 205, in load 2836s module = import_module(match.group('module')) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3.12/importlib/__init__.py", line 90, in import_module 2836s return _bootstrap._gcd_import(name[level:], package, level) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "", line 1387, in _gcd_import 2836s File "", line 1360, in _find_and_load 2836s File "", line 1310, in _find_and_load_unlocked 2836s File "", line 488, in _call_with_frames_removed 2836s File "", line 1387, in _gcd_import 2836s File "", line 1360, in _find_and_load 2836s File "", line 1310, in _find_and_load_unlocked 2836s File "", line 488, in _call_with_frames_removed 2836s File "", line 1387, in _gcd_import 2836s File "", line 1360, in _find_and_load 2836s File "", line 1331, in _find_and_load_unlocked 2836s File "", line 935, in _load_unlocked 2836s File "", line 995, in exec_module 2836s File "", line 488, in _call_with_frames_removed 2836s File "/usr/lib/python3/dist-packages/distributed/__init__.py", line 23, in 2836s from distributed.actor import Actor, ActorFuture, BaseActorFuture 2836s File "/usr/lib/python3/dist-packages/distributed/actor.py", line 13, in 2836s from distributed.client import Future 2836s File "/usr/lib/python3/dist-packages/distributed/client.py", line 52, in 2836s from distributed.core import OKMessage 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 36, in 2836s from distributed import profile, protocol 2836s File "/usr/lib/python3/dist-packages/distributed/protocol/__init__.py", line 6, in 2836s from distributed.protocol.core import decompress, dumps, loads, maybe_compress, msgpack 2836s File "/usr/lib/python3/dist-packages/distributed/protocol/core.py", line 7, in 2836s from distributed.protocol import pickle 2836s File "/usr/lib/python3/dist-packages/distributed/protocol/pickle.py", line 11, in 2836s from distributed.protocol.serialize import dask_deserialize, dask_serialize 2836s File "/usr/lib/python3/dist-packages/distributed/protocol/serialize.py", line 24, in 2836s from distributed.protocol.utils import ( 2836s File "/usr/lib/python3/dist-packages/distributed/protocol/utils.py", line 26, in 2836s import numpy 2836s File "/usr/lib/python3/dist-packages/numpy/__init__.py", line 149, in 2836s from . import lib 2836s File "/usr/lib/python3/dist-packages/numpy/lib/__init__.py", line 23, in 2836s from . import index_tricks 2836s File "/usr/lib/python3/dist-packages/numpy/lib/index_tricks.py", line 12, in 2836s import numpy.matrixlib as matrixlib 2836s File "/usr/lib/python3/dist-packages/numpy/matrixlib/__init__.py", line 4, in 2836s from . import defmatrix 2836s File "", line 1360, in _find_and_load 2836s File "", line 1331, in _find_and_load_unlocked 2836s File "", line 935, in _load_unlocked 2836s File "", line 991, in exec_module 2836s File "", line 1124, in get_code 2836s File "", line 753, in _compile_bytecode 2836s KeyboardInterrupt 2836s 2024-11-24 00:29:20,602 - distributed._signals - INFO - Received signal SIGINT (2) 2836s 2024-11-24 00:29:20,602 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 2836s 2024-11-24 00:29:20,602 - distributed.scheduler - INFO - Scheduler closing all comms 2836s 2024-11-24 00:29:20,603 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.145.243.241:39709' 2836s 2024-11-24 00:29:20,603 - distributed.scheduler - INFO - End scheduler 2836s _____________________________ test_use_config_file _____________________________ 2836s 2836s self = 2836s address = '127.0.0.1:49349', deserialize = True 2836s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 2836s ip = '127.0.0.1', port = 49349 2836s kwargs = {'ssl_options': } 2836s 2836s async def connect(self, address, deserialize=True, **connection_args): 2836s self._check_encryption(address, connection_args) 2836s ip, port = parse_host_port(address) 2836s kwargs = self._get_connect_args(**connection_args) 2836s 2836s try: 2836s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 2836s if "server_hostname" in kwargs: 2836s stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE 2836s ) 2836s stream = await stream.start_tls(False, **kwargs) 2836s else: 2836s > stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ) 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 2836s stream = await stream.start_tls( 2836s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 2836s self.socket.do_handshake() 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = , block = False 2836s 2836s @_sslcopydoc 2836s def do_handshake(self, block=False): 2836s self._check_connected() 2836s timeout = self.gettimeout() 2836s try: 2836s if timeout == 0.0 and block: 2836s self.settimeout(None) 2836s > self._sslobj.do_handshake() 2836s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2836s 2836s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s loop = 2836s 2836s def test_use_config_file(loop): 2836s port = open_port() 2836s with new_config_file(tls_only_config()): 2836s with popen( 2836s [ 2836s "dask", 2836s "scheduler", 2836s "--no-dashboard", 2836s "--host", 2836s "tls://", 2836s "--port", 2836s str(port), 2836s ] 2836s ) as s: 2836s with popen( 2836s ["dask", "worker", "--no-dashboard", f"tls://127.0.0.1:{port}"] 2836s ) as w: 2836s > with Client( 2836s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 2836s ) as c: 2836s 2836s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:122: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 2836s self.start(timeout=timeout) 2836s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 2836s sync(self.loop, self._start, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 2836s raise error 2836s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 2836s result = yield future 2836s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 2836s value = future.result() 2836s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 2836s await self._ensure_connected(timeout=timeout) 2836s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 2836s comm = await connect( 2836s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2836s comm = await wait_for( 2836s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2836s return await fut 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s address = '127.0.0.1:49349', deserialize = True 2836s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 2836s ip = '127.0.0.1', port = 49349 2836s kwargs = {'ssl_options': } 2836s 2836s async def connect(self, address, deserialize=True, **connection_args): 2836s self._check_encryption(address, connection_args) 2836s ip, port = parse_host_port(address) 2836s kwargs = self._get_connect_args(**connection_args) 2836s 2836s try: 2836s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 2836s if "server_hostname" in kwargs: 2836s stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE 2836s ) 2836s stream = await stream.start_tls(False, **kwargs) 2836s else: 2836s stream = await self.client.connect( 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ) 2836s 2836s # Under certain circumstances tornado will have a closed connection with an 2836s # error and not raise a StreamClosedError. 2836s # 2836s # This occurs with tornado 5.x and openssl 1.1+ 2836s if stream.closed() and stream.error: 2836s raise StreamClosedError(stream.error) 2836s 2836s except StreamClosedError as e: 2836s # The socket connect() call failed 2836s convert_stream_closed_error(self, e) 2836s except SSLCertVerificationError as err: 2836s > raise FatalCommClosedError( 2836s "TLS certificate does not match. Check your security settings. " 2836s "More info at https://distributed.dask.org/en/latest/tls.html" 2836s ) from err 2836s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2836s 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 2836s ----------------------------- Captured stderr call ----------------------------- 2836s 2024-11-24 00:29:21,567 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:29:21,583 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 2836s 2024-11-24 00:29:21,586 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:29:21,590 - distributed.scheduler - INFO - ----------------------------------------------- 2836s 2024-11-24 00:29:21,592 - distributed.scheduler - INFO - Scheduler at: tls://10.145.243.241:49349 2836s 2024-11-24 00:29:21,592 - distributed.scheduler - INFO - dashboard at: http://10.145.243.241:8787/status 2836s 2024-11-24 00:29:21,592 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:29:21,605 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:49349': TLS handshake failed with remote 'tls://127.0.0.1:42396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 2836s 2024-11-24 00:29:21,606 - distributed._signals - INFO - Received signal SIGINT (2) 2836s 2024-11-24 00:29:21,607 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37625'. Reason: signal-2 2836s 2024-11-24 00:29:21,612 - distributed.dask_worker - INFO - End worker 2836s ConnectionRefusedError: [Errno 111] Connection refused 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 2836s convert_stream_closed_error(self, e) 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 2836s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 2836s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 2836s 2836s During handling of the above exception, another exception occurred: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2836s return await self._connect(addr=addr, timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2836s comm = await connect( 2836s ^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 2836s await asyncio.sleep(backoff) 2836s File "/usr/lib/python3.12/asyncio/tasks.py", line 665, in sleep 2836s return await future 2836s ^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1611, in connect 2836s async with asyncio.timeout(math.inf) as scope: 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s During handling of the above exception, another exception occurred: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2836s comm = await self.rpc.connect(saddr) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1632, in connect 2836s raise CommClosedError(reason) 2836s distributed.comm.core.CommClosedError: ConnectionPool closing. 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/bin/dask", line 8, in 2836s sys.exit(main()) 2836s ^^^^^^ 2836s File "/usr/lib/python3/dist-packages/dask/__main__.py", line 7, in main 2836s run_cli() 2836s File "/usr/lib/python3/dist-packages/dask/cli.py", line 209, in run_cli 2836s cli() 2836s File "/usr/lib/python3/dist-packages/click/core.py", line 1157, in __call__ 2836s return self.main(*args, **kwargs) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/click/core.py", line 1078, in main 2836s rv = self.invoke(ctx) 2836s ^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/click/core.py", line 1688, in invoke 2836s return _process_result(sub_ctx.command.invoke(sub_ctx)) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/click/core.py", line 1434, in invoke 2836s return ctx.invoke(self.callback, **ctx.params) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/click/core.py", line 783, in invoke 2836s return __callback(*args, **kwargs) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/cli/dask_worker.py", line 450, in main 2836s asyncio_run(run(), loop_factory=get_loop_factory()) 2836s File "/usr/lib/python3.12/asyncio/runners.py", line 194, in run 2836s return runner.run(main) 2836s ^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3.12/asyncio/runners.py", line 118, in run 2836s return self._loop.run_until_complete(task) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3.12/asyncio/base_events.py", line 686, in run_until_complete 2836s return future.result() 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/cli/dask_worker.py", line 447, in run 2836s [task.result() for task in done] 2836s ^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/cli/dask_worker.py", line 420, in wait_for_nannies_to_finish 2836s await asyncio.gather(*nannies) 2836s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2836s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2836s RuntimeError: Nanny failed to start. 2836s 2024-11-24 00:29:23,124 - distributed._signals - INFO - Received signal SIGINT (2) 2836s 2024-11-24 00:29:23,125 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 2836s 2024-11-24 00:29:23,125 - distributed.scheduler - INFO - Scheduler closing all comms 2836s 2024-11-24 00:29:23,125 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.145.243.241:49349' 2836s 2024-11-24 00:29:23,126 - distributed.scheduler - INFO - End scheduler 2836s __________________________________ test_basic __________________________________ 2836s 2836s @pytest.mark.skipif(WINDOWS, reason="distributed#7434") 2836s @gen_test() 2836s async def test_basic(): 2836s async with SubprocessCluster( 2836s asynchronous=True, 2836s dashboard_address=":0", 2836s scheduler_kwargs={"idle_timeout": "5s"}, 2836s worker_kwargs={"death_timeout": "5s"}, 2836s ) as cluster: 2836s async with Client(cluster, asynchronous=True) as client: 2836s > result = await client.submit(lambda x: x + 1, 10) 2836s 2836s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:27: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s raiseit = True 2836s 2836s async def _result(self, raiseit=True): 2836s await self._state.wait() 2836s if self.status == "error": 2836s exc = clean_exception(self._state.exception, self._state.traceback) 2836s if raiseit: 2836s typ, exc, tb = exc 2836s > raise exc.with_traceback(tb) 2836s E SystemError: no locals found when setting up annotations 2836s 2836s /usr/lib/python3/dist-packages/distributed/client.py:337: SystemError 2836s ----------------------------- Captured stderr call ----------------------------- 2836s 2024-11-24 00:29:28,624 - distributed.worker - WARNING - Compute Failed 2836s Key: lambda-f3b41d234e8d3805a39c193d3564145c 2836s Function: lambda 2836s args: (10) 2836s kwargs: {} 2836s Exception: "SystemError('no locals found when setting up annotations')" 2836s 2836s ________________________________ test_n_workers ________________________________ 2836s 2836s @pytest.mark.skipif(WINDOWS, reason="distributed#7434") 2836s @gen_test() 2836s async def test_n_workers(): 2836s async with SubprocessCluster( 2836s asynchronous=True, dashboard_address=":0", n_workers=2 2836s ) as cluster: 2836s async with Client(cluster, asynchronous=True) as client: 2836s assert len(cluster.workers) == 2 2836s > result = await client.submit(lambda x: x + 1, 10) 2836s 2836s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:41: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s raiseit = True 2836s 2836s async def _result(self, raiseit=True): 2836s await self._state.wait() 2836s if self.status == "error": 2836s exc = clean_exception(self._state.exception, self._state.traceback) 2836s if raiseit: 2836s typ, exc, tb = exc 2836s > raise exc.with_traceback(tb) 2836s E SystemError: no locals found when setting up annotations 2836s 2836s /usr/lib/python3/dist-packages/distributed/client.py:337: SystemError 2836s ----------------------------- Captured stderr call ----------------------------- 2836s 2024-11-24 00:29:30,472 - distributed.worker - WARNING - Compute Failed 2836s Key: lambda-181b28c0c705f6e48fbf22b0c3a995c6 2836s Function: lambda 2836s args: (10) 2836s kwargs: {} 2836s Exception: "SystemError('no locals found when setting up annotations')" 2836s 2836s _____________________________ test_upload_file_zip _____________________________ 2836s 2836s c = 2836s s = 2836s a = 2836s b = 2836s 2836s @gen_cluster(client=True) 2836s async def test_upload_file_zip(c, s, a, b): 2836s def g(): 2836s import myfile 2836s 2836s return myfile.f() 2836s 2836s with save_sys_modules(): 2836s try: 2836s for value in [123, 456]: 2836s with tmp_text( 2836s "myfile.py", f"def f():\n return {value}" 2836s ) as fn_my_file: 2836s with zipfile.ZipFile("myfile.zip", "w") as z: 2836s z.write(fn_my_file, arcname=os.path.basename(fn_my_file)) 2836s > await c.upload_file("myfile.zip") 2836s 2836s /usr/lib/python3/dist-packages/distributed/tests/test_client.py:1716: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/client.py:3824: in _ 2836s results = await asyncio.gather( 2836s /usr/lib/python3/dist-packages/distributed/client.py:4939: in _register_scheduler_plugin 2836s return await self.scheduler.register_scheduler_plugin( 2836s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 2836s return await send_recv(comm=comm, op=key, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/core.py:1179: in send_recv 2836s raise exc.with_traceback(tb) 2836s /usr/lib/python3/dist-packages/distributed/core.py:970: in _handle_comm 2836s result = await result 2836s /usr/lib/python3/dist-packages/distributed/scheduler.py:6035: in register_scheduler_plugin 2836s await result 2836s /usr/lib/python3/dist-packages/distributed/diagnostics/plugin.py:396: in start 2836s await scheduler.upload_file(self.filename, self.data, load=self.load) 2836s /usr/lib/python3/dist-packages/distributed/core.py:563: in upload_file 2836s raise e 2836s /usr/lib/python3/dist-packages/distributed/core.py:560: in upload_file 2836s import_file(out_filename) 2836s /usr/lib/python3/dist-packages/distributed/utils.py:1162: in import_file 2836s names_to_import.extend(names) 2836s /usr/lib/python3/dist-packages/distributed/utils.py:1161: in 2836s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 2836s /usr/lib/python3.13/pkgutil.py:116: in iter_modules 2836s for name, ispkg in iter_importer_modules(i, prefix): 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s """Utilities to support packages.""" 2836s 2836s from collections import namedtuple 2836s from functools import singledispatch as simplegeneric 2836s import importlib 2836s import importlib.util 2836s import importlib.machinery 2836s import os 2836s import os.path 2836s import sys 2836s from types import ModuleType 2836s import warnings 2836s 2836s __all__ = [ 2836s 'get_importer', 'iter_importers', 'get_loader', 'find_loader', 2836s 'walk_packages', 'iter_modules', 'get_data', 2836s 'read_code', 'extend_path', 2836s 'ModuleInfo', 2836s ] 2836s 2836s 2836s ModuleInfo = namedtuple('ModuleInfo', 'module_finder name ispkg') 2836s ModuleInfo.__doc__ = 'A namedtuple with minimal info about a module.' 2836s 2836s 2836s def read_code(stream): 2836s # This helper is needed in order for the PEP 302 emulation to 2836s # correctly handle compiled files 2836s import marshal 2836s 2836s magic = stream.read(4) 2836s if magic != importlib.util.MAGIC_NUMBER: 2836s return None 2836s 2836s stream.read(12) # Skip rest of the header 2836s return marshal.load(stream) 2836s 2836s 2836s def walk_packages(path=None, prefix='', onerror=None): 2836s """Yields ModuleInfo for all modules recursively 2836s on path, or, if path is None, all accessible modules. 2836s 2836s 'path' should be either None or a list of paths to look for 2836s modules in. 2836s 2836s 'prefix' is a string to output on the front of every module name 2836s on output. 2836s 2836s Note that this function must import all *packages* (NOT all 2836s modules!) on the given path, in order to access the __path__ 2836s attribute to find submodules. 2836s 2836s 'onerror' is a function which gets called with one argument (the 2836s name of the package which was being imported) if any exception 2836s occurs while trying to import a package. If no onerror function is 2836s supplied, ImportErrors are caught and ignored, while all other 2836s exceptions are propagated, terminating the search. 2836s 2836s Examples: 2836s 2836s # list all modules python can access 2836s walk_packages() 2836s 2836s # list all submodules of ctypes 2836s walk_packages(ctypes.__path__, ctypes.__name__+'.') 2836s """ 2836s 2836s def seen(p, m={}): 2836s if p in m: 2836s return True 2836s m[p] = True 2836s 2836s for info in iter_modules(path, prefix): 2836s yield info 2836s 2836s if info.ispkg: 2836s try: 2836s __import__(info.name) 2836s except ImportError: 2836s if onerror is not None: 2836s onerror(info.name) 2836s except Exception: 2836s if onerror is not None: 2836s onerror(info.name) 2836s else: 2836s raise 2836s else: 2836s path = getattr(sys.modules[info.name], '__path__', None) or [] 2836s 2836s # don't traverse path items we've seen before 2836s path = [p for p in path if not seen(p)] 2836s 2836s yield from walk_packages(path, info.name+'.', onerror) 2836s 2836s 2836s def iter_modules(path=None, prefix=''): 2836s """Yields ModuleInfo for all submodules on path, 2836s or, if path is None, all top-level modules on sys.path. 2836s 2836s 'path' should be either None or a list of paths to look for 2836s modules in. 2836s 2836s 'prefix' is a string to output on the front of every module name 2836s on output. 2836s """ 2836s if path is None: 2836s importers = iter_importers() 2836s elif isinstance(path, str): 2836s raise ValueError("path must be None or list of paths to look for " 2836s "modules in") 2836s else: 2836s importers = map(get_importer, path) 2836s 2836s yielded = {} 2836s for i in importers: 2836s for name, ispkg in iter_importer_modules(i, prefix): 2836s if name not in yielded: 2836s yielded[name] = 1 2836s yield ModuleInfo(i, name, ispkg) 2836s 2836s 2836s @simplegeneric 2836s def iter_importer_modules(importer, prefix=''): 2836s if not hasattr(importer, 'iter_modules'): 2836s return [] 2836s return importer.iter_modules(prefix) 2836s 2836s 2836s # Implement a file walker for the normal importlib path hook 2836s def _iter_file_finder_modules(importer, prefix=''): 2836s if importer.path is None or not os.path.isdir(importer.path): 2836s return 2836s 2836s yielded = {} 2836s import inspect 2836s try: 2836s filenames = os.listdir(importer.path) 2836s except OSError: 2836s # ignore unreadable directories like import does 2836s filenames = [] 2836s filenames.sort() # handle packages before same-named modules 2836s 2836s for fn in filenames: 2836s modname = inspect.getmodulename(fn) 2836s if modname=='__init__' or modname in yielded: 2836s continue 2836s 2836s path = os.path.join(importer.path, fn) 2836s ispkg = False 2836s 2836s if not modname and os.path.isdir(path) and '.' not in fn: 2836s modname = fn 2836s try: 2836s dircontents = os.listdir(path) 2836s except OSError: 2836s # ignore unreadable directories like import does 2836s dircontents = [] 2836s for fn in dircontents: 2836s subname = inspect.getmodulename(fn) 2836s if subname=='__init__': 2836s ispkg = True 2836s break 2836s else: 2836s continue # not a package 2836s 2836s if modname and '.' not in modname: 2836s yielded[modname] = 1 2836s yield prefix + modname, ispkg 2836s 2836s iter_importer_modules.register( 2836s importlib.machinery.FileFinder, _iter_file_finder_modules) 2836s 2836s 2836s try: 2836s import zipimport 2836s from zipimport import zipimporter 2836s 2836s def iter_zipimport_modules(importer, prefix=''): 2836s > dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 2836s E KeyError: '/tmp/dask-scratch-space/scheduler-irr8s021/myfile.zip' 2836s 2836s /usr/lib/python3.13/pkgutil.py:179: KeyError 2836s ----------------------------- Captured stdout call ----------------------------- 2836s Dumped cluster state to test_cluster_dump/test_upload_file_zip.yaml 2836s ----------------------------- Captured stderr call ----------------------------- 2836s 2024-11-24 00:33:14,828 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:33:14,831 - distributed.scheduler - INFO - Scheduler at: tcp://127.0.0.1:43931 2836s 2024-11-24 00:33:14,831 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39141/status 2836s 2024-11-24 00:33:14,831 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:33:14,836 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:37679 2836s 2024-11-24 00:33:14,836 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:37679 2836s 2024-11-24 00:33:14,836 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:33:14,836 - distributed.worker - INFO - dashboard at: 127.0.0.1:45757 2836s 2024-11-24 00:33:14,836 - distributed.worker - INFO - Waiting to connect to: tcp://127.0.0.1:43931 2836s 2024-11-24 00:33:14,836 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:33:14,836 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:33:14,836 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:33:14,836 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-20j_xr71 2836s 2024-11-24 00:33:14,836 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:33:14,837 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:34985 2836s 2024-11-24 00:33:14,837 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:34985 2836s 2024-11-24 00:33:14,837 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:33:14,837 - distributed.worker - INFO - dashboard at: 127.0.0.1:34517 2836s 2024-11-24 00:33:14,838 - distributed.worker - INFO - Waiting to connect to: tcp://127.0.0.1:43931 2836s 2024-11-24 00:33:14,838 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:33:14,838 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:33:14,838 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:33:14,838 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_yvah9pg 2836s 2024-11-24 00:33:14,838 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:33:14,854 - distributed.scheduler - INFO - Register worker 2836s 2024-11-24 00:33:14,860 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:37679 2836s 2024-11-24 00:33:14,860 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:43906 2836s 2024-11-24 00:33:14,862 - distributed.scheduler - INFO - Register worker 2836s 2024-11-24 00:33:14,869 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:34985 2836s 2024-11-24 00:33:14,869 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:43922 2836s 2024-11-24 00:33:14,869 - distributed.worker - INFO - Starting Worker plugin shuffle 2836s 2024-11-24 00:33:14,870 - distributed.worker - INFO - Starting Worker plugin shuffle 2836s 2024-11-24 00:33:14,870 - distributed.worker - INFO - Registered to: tcp://127.0.0.1:43931 2836s 2024-11-24 00:33:14,870 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:33:14,870 - distributed.worker - INFO - Registered to: tcp://127.0.0.1:43931 2836s 2024-11-24 00:33:14,870 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:33:14,871 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:43931 2836s 2024-11-24 00:33:14,871 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:43931 2836s 2024-11-24 00:33:14,881 - distributed.scheduler - INFO - Receive client connection: Client-b153bd92-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:33:14,887 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:43938 2836s 2024-11-24 00:33:14,893 - distributed.utils - INFO - Reload module myfile from .zip file 2836s 2024-11-24 00:33:14,894 - distributed.scheduler - INFO - Registering Worker plugin myfile.zipe0cd30ee-124c-4929-8cd6-87cf20337bcd 2836s 2024-11-24 00:33:14,897 - distributed.worker - INFO - Starting Worker plugin myfile.zipe0cd30ee-124c-4929-8cd6-87cf20337bcd 2836s 2024-11-24 00:33:14,899 - distributed.utils - INFO - Reload module myfile from .zip file 2836s 2024-11-24 00:33:14,900 - distributed.worker - INFO - Starting Worker plugin myfile.zipe0cd30ee-124c-4929-8cd6-87cf20337bcd 2836s 2024-11-24 00:33:14,902 - distributed.utils - INFO - Reload module myfile from .zip file 2836s 2024-11-24 00:33:14,913 - distributed.core - ERROR - '/tmp/dask-scratch-space/scheduler-irr8s021/myfile.zip' 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 2836s import_file(out_filename) 2836s ~~~~~~~~~~~^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 2836s names_to_import.extend(names) 2836s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 2836s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 2836s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 2836s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 2836s for name, ispkg in iter_importer_modules(i, prefix): 2836s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 2836s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 2836s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 2836s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 2836s KeyError: '/tmp/dask-scratch-space/scheduler-irr8s021/myfile.zip' 2836s 2024-11-24 00:33:14,914 - distributed.core - ERROR - Exception while handling op register_scheduler_plugin 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 970, in _handle_comm 2836s result = await result 2836s ^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/scheduler.py", line 6035, in register_scheduler_plugin 2836s await result 2836s File "/usr/lib/python3/dist-packages/distributed/diagnostics/plugin.py", line 396, in start 2836s await scheduler.upload_file(self.filename, self.data, load=self.load) 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 563, in upload_file 2836s raise e 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 2836s import_file(out_filename) 2836s ~~~~~~~~~~~^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 2836s names_to_import.extend(names) 2836s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 2836s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 2836s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 2836s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 2836s for name, ispkg in iter_importer_modules(i, prefix): 2836s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 2836s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 2836s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 2836s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 2836s KeyError: '/tmp/dask-scratch-space/scheduler-irr8s021/myfile.zip' 2836s 2024-11-24 00:33:14,919 - distributed.scheduler - INFO - Registering Worker plugin myfile.zip7e3c9937-ec42-428c-968a-ab824651149b 2836s 2024-11-24 00:33:14,921 - distributed.worker - INFO - Starting Worker plugin myfile.zip7e3c9937-ec42-428c-968a-ab824651149b 2836s 2024-11-24 00:33:14,923 - distributed.core - ERROR - '/tmp/dask-scratch-space/worker-_yvah9pg/myfile.zip' 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 2836s import_file(out_filename) 2836s ~~~~~~~~~~~^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 2836s names_to_import.extend(names) 2836s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 2836s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 2836s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 2836s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 2836s for name, ispkg in iter_importer_modules(i, prefix): 2836s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 2836s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 2836s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 2836s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 2836s KeyError: '/tmp/dask-scratch-space/worker-_yvah9pg/myfile.zip' 2836s 2024-11-24 00:33:14,999 - distributed.worker - INFO - Starting Worker plugin myfile.zip7e3c9937-ec42-428c-968a-ab824651149b 2836s 2024-11-24 00:33:15,001 - distributed.utils - INFO - Reload module myfile from .zip file 2836s 2024-11-24 00:33:15,003 - distributed.scheduler - INFO - Remove client Client-b153bd92-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:33:15,003 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:43938; closing. 2836s 2024-11-24 00:33:15,003 - distributed.scheduler - INFO - Remove client Client-b153bd92-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:33:15,005 - distributed.scheduler - INFO - Close client connection: Client-b153bd92-a9fb-11ef-909a-fa163e857b72 2836s 2024-11-24 00:33:15,006 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:37679. Reason: worker-close 2836s 2024-11-24 00:33:15,006 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:34985. Reason: worker-close 2836s 2024-11-24 00:33:15,008 - distributed.core - INFO - Connection to tcp://127.0.0.1:43931 has been closed. 2836s 2024-11-24 00:33:15,008 - distributed.core - INFO - Connection to tcp://127.0.0.1:43931 has been closed. 2836s 2024-11-24 00:33:15,008 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:43906; closing. 2836s 2024-11-24 00:33:15,009 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:43922; closing. 2836s 2024-11-24 00:33:15,009 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732408395.0093565') 2836s 2024-11-24 00:33:15,009 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732408395.0096607') 2836s 2024-11-24 00:33:15,009 - distributed.scheduler - INFO - Lost all workers 2836s 2024-11-24 00:33:15,011 - distributed.scheduler - INFO - Scheduler closing due to unknown reason... 2836s 2024-11-24 00:33:15,011 - distributed.scheduler - INFO - Scheduler closing all comms 2836s ________________________ test_info_frame_f_lineno[22-4] ________________________ 2836s 2836s f_lasti = 22, f_lineno = 4 2836s 2836s @pytest.mark.parametrize( 2836s "f_lasti,f_lineno", 2836s [ 2836s (-1, 1), 2836s (0, 2), 2836s (1, 2), 2836s (11, 2), 2836s (12, 3), 2836s (21, 4), 2836s (22, 4), 2836s (23, 4), 2836s (24, 2), 2836s (25, 2), 2836s (26, 2), 2836s (27, 2), 2836s (100, 2), 2836s ], 2836s ) 2836s def test_info_frame_f_lineno(f_lasti: int, f_lineno: int) -> None: 2836s > assert info_frame(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == { # type: ignore 2836s "filename": "", 2836s "name": "example", 2836s "line_number": f_lineno, 2836s "line": "", 2836s } 2836s 2836s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:327: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/profile.py:115: in info_frame 2836s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s filename = '', lineno = None, module_globals = {} 2836s 2836s def getline(filename, lineno, module_globals=None): 2836s """Get a line for a Python source file from the cache. 2836s Update the cache if it doesn't contain an entry for this file already.""" 2836s 2836s lines = getlines(filename, module_globals) 2836s > if 1 <= lineno <= len(lines): 2836s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 2836s 2836s /usr/lib/python3.13/linecache.py:26: TypeError 2836s ________________________ test_info_frame_f_lineno[23-4] ________________________ 2836s 2836s f_lasti = 23, f_lineno = 4 2836s 2836s @pytest.mark.parametrize( 2836s "f_lasti,f_lineno", 2836s [ 2836s (-1, 1), 2836s (0, 2), 2836s (1, 2), 2836s (11, 2), 2836s (12, 3), 2836s (21, 4), 2836s (22, 4), 2836s (23, 4), 2836s (24, 2), 2836s (25, 2), 2836s (26, 2), 2836s (27, 2), 2836s (100, 2), 2836s ], 2836s ) 2836s def test_info_frame_f_lineno(f_lasti: int, f_lineno: int) -> None: 2836s > assert info_frame(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == { # type: ignore 2836s "filename": "", 2836s "name": "example", 2836s "line_number": f_lineno, 2836s "line": "", 2836s } 2836s 2836s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:327: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/profile.py:115: in info_frame 2836s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s filename = '', lineno = None, module_globals = {} 2836s 2836s def getline(filename, lineno, module_globals=None): 2836s """Get a line for a Python source file from the cache. 2836s Update the cache if it doesn't contain an entry for this file already.""" 2836s 2836s lines = getlines(filename, module_globals) 2836s > if 1 <= lineno <= len(lines): 2836s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 2836s 2836s /usr/lib/python3.13/linecache.py:26: TypeError 2836s ________________________ test_call_stack_f_lineno[22-4] ________________________ 2836s 2836s f_lasti = 22, f_lineno = 4 2836s 2836s @pytest.mark.parametrize( 2836s "f_lasti,f_lineno", 2836s [ 2836s (-1, 1), 2836s (0, 2), 2836s (1, 2), 2836s (11, 2), 2836s (12, 3), 2836s (21, 4), 2836s (22, 4), 2836s (23, 4), 2836s (24, 2), 2836s (25, 2), 2836s (26, 2), 2836s (27, 2), 2836s (100, 2), 2836s ], 2836s ) 2836s def test_call_stack_f_lineno(f_lasti: int, f_lineno: int) -> None: 2836s > assert call_stack(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == [ # type: ignore 2836s f' File "", line {f_lineno}, in example\n\t' 2836s ] 2836s 2836s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:354: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/profile.py:263: in call_stack 2836s L.append(repr_frame(cur_frame)) 2836s /usr/lib/python3/dist-packages/distributed/profile.py:105: in repr_frame 2836s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s filename = '', lineno = None, module_globals = {} 2836s 2836s def getline(filename, lineno, module_globals=None): 2836s """Get a line for a Python source file from the cache. 2836s Update the cache if it doesn't contain an entry for this file already.""" 2836s 2836s lines = getlines(filename, module_globals) 2836s > if 1 <= lineno <= len(lines): 2836s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 2836s 2836s /usr/lib/python3.13/linecache.py:26: TypeError 2836s ________________________ test_call_stack_f_lineno[23-4] ________________________ 2836s 2836s f_lasti = 23, f_lineno = 4 2836s 2836s @pytest.mark.parametrize( 2836s "f_lasti,f_lineno", 2836s [ 2836s (-1, 1), 2836s (0, 2), 2836s (1, 2), 2836s (11, 2), 2836s (12, 3), 2836s (21, 4), 2836s (22, 4), 2836s (23, 4), 2836s (24, 2), 2836s (25, 2), 2836s (26, 2), 2836s (27, 2), 2836s (100, 2), 2836s ], 2836s ) 2836s def test_call_stack_f_lineno(f_lasti: int, f_lineno: int) -> None: 2836s > assert call_stack(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == [ # type: ignore 2836s f' File "", line {f_lineno}, in example\n\t' 2836s ] 2836s 2836s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:354: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/profile.py:263: in call_stack 2836s L.append(repr_frame(cur_frame)) 2836s /usr/lib/python3/dist-packages/distributed/profile.py:105: in repr_frame 2836s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s filename = '', lineno = None, module_globals = {} 2836s 2836s def getline(filename, lineno, module_globals=None): 2836s """Get a line for a Python source file from the cache. 2836s Update the cache if it doesn't contain an entry for this file already.""" 2836s 2836s lines = getlines(filename, module_globals) 2836s > if 1 <= lineno <= len(lines): 2836s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 2836s 2836s /usr/lib/python3.13/linecache.py:26: TypeError 2836s ______________________________ test_broadcast_tls ______________________________ 2836s 2836s fut = , timeout = 0 2836s 2836s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2836s async with asyncio.timeout(timeout): 2836s > return await fut 2836s 2836s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 2836s await self._register_with_scheduler() 2836s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2836s comm = await wait_for( 2836s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2836s return await fut 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 2836s stream = await self.client.connect( 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s host = '127.0.0.1', port = 37023, af = 2836s ssl_options = 2836s max_buffer_size = 4151066624.0, source_ip = None, source_port = None 2836s timeout = None 2836s 2836s async def connect( 2836s self, 2836s host: str, 2836s port: int, 2836s af: socket.AddressFamily = socket.AF_UNSPEC, 2836s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 2836s max_buffer_size: Optional[int] = None, 2836s source_ip: Optional[str] = None, 2836s source_port: Optional[int] = None, 2836s timeout: Optional[Union[float, datetime.timedelta]] = None, 2836s ) -> IOStream: 2836s """Connect to the given host and port. 2836s 2836s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 2836s ``ssl_options`` is not None). 2836s 2836s Using the ``source_ip`` kwarg, one can specify the source 2836s IP address to use when establishing the connection. 2836s In case the user needs to resolve and 2836s use a specific interface, it has to be handled outside 2836s of Tornado as this depends very much on the platform. 2836s 2836s Raises `TimeoutError` if the input future does not complete before 2836s ``timeout``, which may be specified in any form allowed by 2836s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 2836s relative to `.IOLoop.time`) 2836s 2836s Similarly, when the user requires a certain source port, it can 2836s be specified using the ``source_port`` arg. 2836s 2836s .. versionchanged:: 4.5 2836s Added the ``source_ip`` and ``source_port`` arguments. 2836s 2836s .. versionchanged:: 5.0 2836s Added the ``timeout`` argument. 2836s """ 2836s if timeout is not None: 2836s if isinstance(timeout, numbers.Real): 2836s timeout = IOLoop.current().time() + timeout 2836s elif isinstance(timeout, datetime.timedelta): 2836s timeout = IOLoop.current().time() + timeout.total_seconds() 2836s else: 2836s raise TypeError("Unsupported timeout %r" % timeout) 2836s if timeout is not None: 2836s addrinfo = await gen.with_timeout( 2836s timeout, self.resolver.resolve(host, port, af) 2836s ) 2836s else: 2836s addrinfo = await self.resolver.resolve(host, port, af) 2836s connector = _Connector( 2836s addrinfo, 2836s functools.partial( 2836s self._create_stream, 2836s max_buffer_size, 2836s source_ip=source_ip, 2836s source_port=source_port, 2836s ), 2836s ) 2836s > af, addr, stream = await connector.start(connect_timeout=timeout) 2836s E asyncio.exceptions.CancelledError 2836s 2836s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s self = 2836s 2836s @final 2836s async def start(self): 2836s async with self._startup_lock: 2836s if self.status == Status.failed: 2836s assert self.__startup_exc is not None 2836s raise self.__startup_exc 2836s elif self.status != Status.init: 2836s return self 2836s timeout = getattr(self, "death_timeout", None) 2836s 2836s async def _close_on_failure(exc: Exception) -> None: 2836s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2836s self.status = Status.failed 2836s self.__startup_exc = exc 2836s 2836s try: 2836s > await wait_for(self.start_unsafe(), timeout=timeout) 2836s 2836s /usr/lib/python3/dist-packages/distributed/core.py:664: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2836s async with asyncio.timeout(timeout): 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s exc_type = 2836s exc_val = CancelledError(), exc_tb = 2836s 2836s async def __aexit__( 2836s self, 2836s exc_type: Optional[Type[BaseException]], 2836s exc_val: Optional[BaseException], 2836s exc_tb: Optional[TracebackType], 2836s ) -> Optional[bool]: 2836s assert self._state in (_State.ENTERED, _State.EXPIRING) 2836s 2836s if self._timeout_handler is not None: 2836s self._timeout_handler.cancel() 2836s self._timeout_handler = None 2836s 2836s if self._state is _State.EXPIRING: 2836s self._state = _State.EXPIRED 2836s 2836s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2836s # Since there are no new cancel requests, we're 2836s # handling this. 2836s if issubclass(exc_type, exceptions.CancelledError): 2836s > raise TimeoutError from exc_val 2836s E TimeoutError 2836s 2836s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s @contextlib.asynccontextmanager 2836s async def _cluster_factory(): 2836s workers = [] 2836s s = None 2836s try: 2836s for _ in range(60): 2836s try: 2836s > s, ws = await start_cluster( 2836s nthreads, 2836s scheduler, 2836s security=security, 2836s Worker=Worker, 2836s scheduler_kwargs=scheduler_kwargs, 2836s worker_kwargs=merge( 2836s {"death_timeout": min(15, int(deadline.remaining))}, 2836s worker_kwargs, 2836s ), 2836s ) 2836s 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 2836s await asyncio.gather(*workers) 2836s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 2836s return await awaitable 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s 2836s @final 2836s async def start(self): 2836s async with self._startup_lock: 2836s if self.status == Status.failed: 2836s assert self.__startup_exc is not None 2836s raise self.__startup_exc 2836s elif self.status != Status.init: 2836s return self 2836s timeout = getattr(self, "death_timeout", None) 2836s 2836s async def _close_on_failure(exc: Exception) -> None: 2836s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2836s self.status = Status.failed 2836s self.__startup_exc = exc 2836s 2836s try: 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s except asyncio.TimeoutError as exc: 2836s await _close_on_failure(exc) 2836s > raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s E TimeoutError: Worker start timed out after 0s. 2836s 2836s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 2836s 2836s During handling of the above exception, another exception occurred: 2836s 2836s fut = ._..test_func..async_fn at 0xe63f7717a9f0> 2836s timeout = 60 2836s 2836s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2836s async with asyncio.timeout(timeout): 2836s > return await fut 2836s 2836s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 2836s _cluster_factory() as (s, workers), 2836s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 2836s return await anext(self.gen) 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 2836s await asyncio.sleep(1) 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s delay = 1, result = None 2836s 2836s async def sleep(delay, result=None): 2836s """Coroutine that completes after a given time (in seconds).""" 2836s if delay <= 0: 2836s await __sleep0() 2836s return result 2836s 2836s if math.isnan(delay): 2836s raise ValueError("Invalid delay: NaN (not a number)") 2836s 2836s loop = events.get_running_loop() 2836s future = loop.create_future() 2836s h = loop.call_later(delay, 2836s futures._set_result_unless_cancelled, 2836s future, result) 2836s try: 2836s > return await future 2836s E asyncio.exceptions.CancelledError 2836s 2836s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s args = (), kwds = {} 2836s 2836s @wraps(func) 2836s def inner(*args, **kwds): 2836s with self._recreate_cm(): 2836s > return func(*args, **kwds) 2836s 2836s /usr/lib/python3.13/contextlib.py:85: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3.13/contextlib.py:85: in inner 2836s return func(*args, **kwds) 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 2836s return _run_and_close_tornado(async_fn_outer) 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 2836s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 2836s /usr/lib/python3.13/asyncio/runners.py:194: in run 2836s return runner.run(main) 2836s /usr/lib/python3.13/asyncio/runners.py:118: in run 2836s return self._loop.run_until_complete(task) 2836s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 2836s return future.result() 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 2836s return await async_fn(*args, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 2836s return await utils_wait_for(async_fn(), timeout=timeout * 2) 2836s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2836s async with asyncio.timeout(timeout): 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s exc_type = 2836s exc_val = CancelledError(), exc_tb = 2836s 2836s async def __aexit__( 2836s self, 2836s exc_type: Optional[Type[BaseException]], 2836s exc_val: Optional[BaseException], 2836s exc_tb: Optional[TracebackType], 2836s ) -> Optional[bool]: 2836s assert self._state in (_State.ENTERED, _State.EXPIRING) 2836s 2836s if self._timeout_handler is not None: 2836s self._timeout_handler.cancel() 2836s self._timeout_handler = None 2836s 2836s if self._state is _State.EXPIRING: 2836s self._state = _State.EXPIRED 2836s 2836s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2836s # Since there are no new cancel requests, we're 2836s # handling this. 2836s if issubclass(exc_type, exceptions.CancelledError): 2836s > raise TimeoutError from exc_val 2836s E TimeoutError 2836s 2836s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2836s ----------------------------- Captured stderr call ----------------------------- 2836s 2024-11-24 00:39:57,977 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:39:57,980 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:57,980 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36775/status 2836s 2024-11-24 00:39:57,981 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:39:57,988 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38705 2836s 2024-11-24 00:39:57,988 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38705 2836s 2024-11-24 00:39:57,988 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:39:57,988 - distributed.worker - INFO - dashboard at: 127.0.0.1:38521 2836s 2024-11-24 00:39:57,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:57,988 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:39:57,988 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:39:57,988 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:39:57,988 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hoi7j6wf 2836s 2024-11-24 00:39:57,988 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:39:57,989 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43105 2836s 2024-11-24 00:39:57,990 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43105 2836s 2024-11-24 00:39:57,990 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:39:57,990 - distributed.worker - INFO - dashboard at: 127.0.0.1:40171 2836s 2024-11-24 00:39:57,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:57,990 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:39:57,990 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:39:57,990 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:39:57,990 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b7gbkgxd 2836s 2024-11-24 00:39:57,990 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:39:58,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:58,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:58,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:58,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:58,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:58,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:58,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:58,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:58,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:58,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:58,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:58,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:58,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:58,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:58,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:58,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:58,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:58,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:58,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:39:59,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:39:59,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:53996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:00,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:00,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:01,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:01,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:02,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:02,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:03,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:03,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:04,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:04,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:54720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:05,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:05,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:06,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:06,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:07,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:07,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:08,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:08,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:09,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:09,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:40998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:10,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:10,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:11,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:11,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2836s 2024-11-24 00:40:12,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:41464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:12,987 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38705. Reason: failure-to-start- 2836s 2024-11-24 00:40:12,987 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:12,989 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43105. Reason: failure-to-start- 2836s 2024-11-24 00:40:12,989 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:12,990 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2836s stream = await stream.start_tls( 2836s ^^^^^^^^^^^^^^^^^^^^^^^ 2836s False, ssl_options=ssl_options, server_hostname=host 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2836s self.socket.do_handshake() 2836s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2836s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2836s self._sslobj.do_handshake() 2836s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2836s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2836s raise FatalCommClosedError( 2836s ...<2 lines>... 2836s ) from err 2836s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2836s 2836s During handling of the above exception, another exception occurred: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2836s await asyncio.sleep(0.1) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2836s return await future 2836s ^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 15s. 2836s 2024-11-24 00:40:13,995 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:13,998 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:13,998 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34375/status 2836s 2024-11-24 00:40:13,999 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:14,005 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33653 2836s 2024-11-24 00:40:14,005 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33653 2836s 2024-11-24 00:40:14,006 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:14,006 - distributed.worker - INFO - dashboard at: 127.0.0.1:40889 2836s 2024-11-24 00:40:14,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,006 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:14,006 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:14,006 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:14,006 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i4bclfx9 2836s 2024-11-24 00:40:14,006 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:14,007 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42671 2836s 2024-11-24 00:40:14,007 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42671 2836s 2024-11-24 00:40:14,007 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:14,007 - distributed.worker - INFO - dashboard at: 127.0.0.1:37899 2836s 2024-11-24 00:40:14,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,007 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:14,007 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:14,007 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:14,007 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-169fiyg5 2836s 2024-11-24 00:40:14,007 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:14,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:14,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:14,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:14,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:14,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:14,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:14,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:14,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:14,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:14,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:14,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:14,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:14,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:14,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:14,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:14,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:14,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:14,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:14,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:15,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:15,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:16,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:16,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:17,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:17,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:18,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:18,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:55988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:19,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:19,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:20,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:20,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:21,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:21,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:22,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:22,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:23,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:23,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:24,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:24,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:56966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:25,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:25,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:26,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 2836s 2024-11-24 00:40:26,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:54548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:40:27,005 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33653. Reason: failure-to-start- 2836s 2024-11-24 00:40:27,005 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:27,006 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2836s stream = await stream.start_tls( 2836s ^^^^^^^^^^^^^^^^^^^^^^^ 2836s False, ssl_options=ssl_options, server_hostname=host 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2836s self.socket.do_handshake() 2836s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2836s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2836s self._sslobj.do_handshake() 2836s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2836s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2836s raise FatalCommClosedError( 2836s ...<2 lines>... 2836s ) from err 2836s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2836s 2836s During handling of the above exception, another exception occurred: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2836s await asyncio.sleep(0.1) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2836s return await future 2836s ^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 13s. 2836s 2024-11-24 00:40:27,009 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42671. Reason: failure-to-start- 2836s 2024-11-24 00:40:27,009 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:28,013 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:28,016 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37581 2836s 2024-11-24 00:40:28,017 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39831/status 2836s 2024-11-24 00:40:28,017 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:28,023 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43083 2836s 2024-11-24 00:40:28,024 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43083 2836s 2024-11-24 00:40:28,024 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:28,024 - distributed.worker - INFO - dashboard at: 127.0.0.1:37663 2836s 2024-11-24 00:40:28,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37581 2836s 2024-11-24 00:40:28,024 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:28,024 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:28,024 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:28,024 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rhqm0lof 2836s 2024-11-24 00:40:28,024 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:28,025 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34629 2836s 2024-11-24 00:40:28,025 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34629 2836s 2024-11-24 00:40:28,025 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:28,025 - distributed.worker - INFO - dashboard at: 127.0.0.1:39449 2836s 2024-11-24 00:40:28,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37581 2836s 2024-11-24 00:40:28,026 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:28,026 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:28,026 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:28,026 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o1d51os3 2836s 2024-11-24 00:40:28,026 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:28,026 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43083. Reason: failure-to-start- 2836s 2024-11-24 00:40:28,026 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:28,027 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34629. Reason: failure-to-start- 2836s 2024-11-24 00:40:28,027 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:28,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37581': TLS handshake failed with remote 'tls://127.0.0.1:52052': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:28,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37581': TLS handshake failed with remote 'tls://127.0.0.1:52068': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:28,029 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:29,035 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:29,039 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46525 2836s 2024-11-24 00:40:29,040 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42939/status 2836s 2024-11-24 00:40:29,040 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:29,048 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41821 2836s 2024-11-24 00:40:29,048 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41821 2836s 2024-11-24 00:40:29,048 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:29,048 - distributed.worker - INFO - dashboard at: 127.0.0.1:42579 2836s 2024-11-24 00:40:29,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46525 2836s 2024-11-24 00:40:29,048 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:29,048 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:29,048 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:29,048 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yho0zz3w 2836s 2024-11-24 00:40:29,048 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:29,049 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39047 2836s 2024-11-24 00:40:29,049 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39047 2836s 2024-11-24 00:40:29,049 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:29,049 - distributed.worker - INFO - dashboard at: 127.0.0.1:42305 2836s 2024-11-24 00:40:29,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46525 2836s 2024-11-24 00:40:29,050 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:29,050 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:29,050 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:29,050 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eivykqf7 2836s 2024-11-24 00:40:29,050 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:29,050 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41821. Reason: failure-to-start- 2836s 2024-11-24 00:40:29,050 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:29,051 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39047. Reason: failure-to-start- 2836s 2024-11-24 00:40:29,051 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:29,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46525': TLS handshake failed with remote 'tls://127.0.0.1:60134': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:29,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46525': TLS handshake failed with remote 'tls://127.0.0.1:60140': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:29,052 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:30,058 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:30,061 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41547 2836s 2024-11-24 00:40:30,062 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34779/status 2836s 2024-11-24 00:40:30,062 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:30,069 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33983 2836s 2024-11-24 00:40:30,069 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33983 2836s 2024-11-24 00:40:30,069 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:30,069 - distributed.worker - INFO - dashboard at: 127.0.0.1:33739 2836s 2024-11-24 00:40:30,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41547 2836s 2024-11-24 00:40:30,069 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:30,070 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:30,070 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:30,070 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sbeflvok 2836s 2024-11-24 00:40:30,070 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:30,072 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37289 2836s 2024-11-24 00:40:30,072 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37289 2836s 2024-11-24 00:40:30,072 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:30,072 - distributed.worker - INFO - dashboard at: 127.0.0.1:36911 2836s 2024-11-24 00:40:30,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41547 2836s 2024-11-24 00:40:30,072 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:30,072 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:30,072 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:30,072 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-02k2sgms 2836s 2024-11-24 00:40:30,072 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:30,073 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33983. Reason: failure-to-start- 2836s 2024-11-24 00:40:30,073 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:30,074 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37289. Reason: failure-to-start- 2836s 2024-11-24 00:40:30,074 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:30,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41547': TLS handshake failed with remote 'tls://127.0.0.1:59246': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:30,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41547': TLS handshake failed with remote 'tls://127.0.0.1:59254': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:30,076 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:31,080 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:31,084 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32815 2836s 2024-11-24 00:40:31,084 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32769/status 2836s 2024-11-24 00:40:31,085 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:31,092 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39303 2836s 2024-11-24 00:40:31,092 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39303 2836s 2024-11-24 00:40:31,092 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:31,092 - distributed.worker - INFO - dashboard at: 127.0.0.1:46155 2836s 2024-11-24 00:40:31,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32815 2836s 2024-11-24 00:40:31,092 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:31,093 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:31,093 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:31,093 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nw8lg5zq 2836s 2024-11-24 00:40:31,093 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:31,094 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41739 2836s 2024-11-24 00:40:31,094 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41739 2836s 2024-11-24 00:40:31,094 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:31,094 - distributed.worker - INFO - dashboard at: 127.0.0.1:43815 2836s 2024-11-24 00:40:31,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32815 2836s 2024-11-24 00:40:31,095 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:31,095 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:31,095 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:31,095 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t23pdw0f 2836s 2024-11-24 00:40:31,095 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:31,095 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39303. Reason: failure-to-start- 2836s 2024-11-24 00:40:31,096 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:31,096 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41739. Reason: failure-to-start- 2836s 2024-11-24 00:40:31,096 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:31,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32815': TLS handshake failed with remote 'tls://127.0.0.1:37942': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:31,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32815': TLS handshake failed with remote 'tls://127.0.0.1:37950': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:31,098 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:32,104 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:32,107 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37021 2836s 2024-11-24 00:40:32,107 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35533/status 2836s 2024-11-24 00:40:32,108 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:32,114 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38811 2836s 2024-11-24 00:40:32,114 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38811 2836s 2024-11-24 00:40:32,114 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:32,115 - distributed.worker - INFO - dashboard at: 127.0.0.1:38927 2836s 2024-11-24 00:40:32,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37021 2836s 2024-11-24 00:40:32,115 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:32,115 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:32,115 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:32,115 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x6e0bgjn 2836s 2024-11-24 00:40:32,115 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:32,116 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39389 2836s 2024-11-24 00:40:32,116 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39389 2836s 2024-11-24 00:40:32,116 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:32,116 - distributed.worker - INFO - dashboard at: 127.0.0.1:36375 2836s 2024-11-24 00:40:32,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37021 2836s 2024-11-24 00:40:32,116 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:32,116 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:32,116 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:32,117 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1xa5pjd8 2836s 2024-11-24 00:40:32,117 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:32,117 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38811. Reason: failure-to-start- 2836s 2024-11-24 00:40:32,117 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:32,118 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39389. Reason: failure-to-start- 2836s 2024-11-24 00:40:32,118 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:32,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37021': TLS handshake failed with remote 'tls://127.0.0.1:36544': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:32,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37021': TLS handshake failed with remote 'tls://127.0.0.1:36556': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:32,120 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:33,124 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:33,127 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42407 2836s 2024-11-24 00:40:33,127 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39067/status 2836s 2024-11-24 00:40:33,128 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:33,136 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44795 2836s 2024-11-24 00:40:33,136 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44795 2836s 2024-11-24 00:40:33,136 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:33,136 - distributed.worker - INFO - dashboard at: 127.0.0.1:44373 2836s 2024-11-24 00:40:33,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42407 2836s 2024-11-24 00:40:33,136 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:33,136 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:33,136 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:33,136 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1hf8vze4 2836s 2024-11-24 00:40:33,136 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:33,137 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43583 2836s 2024-11-24 00:40:33,138 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43583 2836s 2024-11-24 00:40:33,138 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:33,138 - distributed.worker - INFO - dashboard at: 127.0.0.1:43695 2836s 2024-11-24 00:40:33,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42407 2836s 2024-11-24 00:40:33,138 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:33,138 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:33,138 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:33,138 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fio8_cu9 2836s 2024-11-24 00:40:33,138 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:33,139 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44795. Reason: failure-to-start- 2836s 2024-11-24 00:40:33,139 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:33,139 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43583. Reason: failure-to-start- 2836s 2024-11-24 00:40:33,139 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:33,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42407': TLS handshake failed with remote 'tls://127.0.0.1:53412': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:33,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42407': TLS handshake failed with remote 'tls://127.0.0.1:53426': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:33,141 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:34,146 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:34,149 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33847 2836s 2024-11-24 00:40:34,149 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42657/status 2836s 2024-11-24 00:40:34,149 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:34,157 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42959 2836s 2024-11-24 00:40:34,157 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42959 2836s 2024-11-24 00:40:34,157 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:34,157 - distributed.worker - INFO - dashboard at: 127.0.0.1:41817 2836s 2024-11-24 00:40:34,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33847 2836s 2024-11-24 00:40:34,157 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:34,157 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:34,157 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:34,157 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ej1et9bg 2836s 2024-11-24 00:40:34,157 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:34,159 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33517 2836s 2024-11-24 00:40:34,160 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33517 2836s 2024-11-24 00:40:34,160 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:34,160 - distributed.worker - INFO - dashboard at: 127.0.0.1:35607 2836s 2024-11-24 00:40:34,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33847 2836s 2024-11-24 00:40:34,160 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:34,160 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:34,160 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:34,160 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-grrv7w4_ 2836s 2024-11-24 00:40:34,160 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:34,161 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42959. Reason: failure-to-start- 2836s 2024-11-24 00:40:34,161 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:34,161 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33517. Reason: failure-to-start- 2836s 2024-11-24 00:40:34,161 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:34,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33847': TLS handshake failed with remote 'tls://127.0.0.1:47758': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:34,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33847': TLS handshake failed with remote 'tls://127.0.0.1:47774': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:34,163 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:35,168 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:35,171 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37865 2836s 2024-11-24 00:40:35,171 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34481/status 2836s 2024-11-24 00:40:35,171 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:35,179 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45079 2836s 2024-11-24 00:40:35,179 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45079 2836s 2024-11-24 00:40:35,179 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:35,179 - distributed.worker - INFO - dashboard at: 127.0.0.1:45371 2836s 2024-11-24 00:40:35,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37865 2836s 2024-11-24 00:40:35,179 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:35,179 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:35,179 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:35,179 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2cs0mu6s 2836s 2024-11-24 00:40:35,179 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:35,180 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33331 2836s 2024-11-24 00:40:35,181 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33331 2836s 2024-11-24 00:40:35,181 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:35,181 - distributed.worker - INFO - dashboard at: 127.0.0.1:38597 2836s 2024-11-24 00:40:35,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37865 2836s 2024-11-24 00:40:35,181 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:35,181 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:35,181 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:35,181 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bbzzqytw 2836s 2024-11-24 00:40:35,181 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:35,182 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45079. Reason: failure-to-start- 2836s 2024-11-24 00:40:35,182 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:35,182 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33331. Reason: failure-to-start- 2836s 2024-11-24 00:40:35,182 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:35,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37865': TLS handshake failed with remote 'tls://127.0.0.1:44540': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:35,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37865': TLS handshake failed with remote 'tls://127.0.0.1:44548': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:35,184 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:36,195 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:36,199 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33813 2836s 2024-11-24 00:40:36,199 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36977/status 2836s 2024-11-24 00:40:36,199 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:36,206 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46105 2836s 2024-11-24 00:40:36,206 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46105 2836s 2024-11-24 00:40:36,206 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:36,206 - distributed.worker - INFO - dashboard at: 127.0.0.1:34901 2836s 2024-11-24 00:40:36,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33813 2836s 2024-11-24 00:40:36,206 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:36,207 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:36,207 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:36,207 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-at4jol8v 2836s 2024-11-24 00:40:36,207 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:36,208 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44041 2836s 2024-11-24 00:40:36,208 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44041 2836s 2024-11-24 00:40:36,208 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:36,208 - distributed.worker - INFO - dashboard at: 127.0.0.1:35011 2836s 2024-11-24 00:40:36,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33813 2836s 2024-11-24 00:40:36,208 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:36,208 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:36,208 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:36,208 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b00doqd4 2836s 2024-11-24 00:40:36,208 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:36,209 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46105. Reason: failure-to-start- 2836s 2024-11-24 00:40:36,209 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:36,210 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44041. Reason: failure-to-start- 2836s 2024-11-24 00:40:36,210 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:36,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33813': TLS handshake failed with remote 'tls://127.0.0.1:37610': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:36,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33813': TLS handshake failed with remote 'tls://127.0.0.1:37622': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:36,212 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:37,216 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:37,220 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34923 2836s 2024-11-24 00:40:37,220 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38393/status 2836s 2024-11-24 00:40:37,220 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:37,229 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37323 2836s 2024-11-24 00:40:37,229 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37323 2836s 2024-11-24 00:40:37,229 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:37,229 - distributed.worker - INFO - dashboard at: 127.0.0.1:46839 2836s 2024-11-24 00:40:37,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34923 2836s 2024-11-24 00:40:37,229 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:37,229 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:37,229 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:37,229 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_it2c0jx 2836s 2024-11-24 00:40:37,229 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:37,231 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37035 2836s 2024-11-24 00:40:37,231 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37035 2836s 2024-11-24 00:40:37,231 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:37,231 - distributed.worker - INFO - dashboard at: 127.0.0.1:40553 2836s 2024-11-24 00:40:37,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34923 2836s 2024-11-24 00:40:37,231 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:37,231 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:37,231 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:37,231 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-230cpv74 2836s 2024-11-24 00:40:37,231 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:37,232 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37323. Reason: failure-to-start- 2836s 2024-11-24 00:40:37,232 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:37,233 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37035. Reason: failure-to-start- 2836s 2024-11-24 00:40:37,233 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:37,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34923': TLS handshake failed with remote 'tls://127.0.0.1:33546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:37,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34923': TLS handshake failed with remote 'tls://127.0.0.1:33560': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:37,235 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:38,240 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:38,243 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42141 2836s 2024-11-24 00:40:38,244 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44167/status 2836s 2024-11-24 00:40:38,244 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:38,251 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32977 2836s 2024-11-24 00:40:38,251 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32977 2836s 2024-11-24 00:40:38,251 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:38,251 - distributed.worker - INFO - dashboard at: 127.0.0.1:36517 2836s 2024-11-24 00:40:38,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42141 2836s 2024-11-24 00:40:38,251 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:38,251 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:38,251 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:38,251 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fn7be5uo 2836s 2024-11-24 00:40:38,251 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:38,253 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32807 2836s 2024-11-24 00:40:38,253 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32807 2836s 2024-11-24 00:40:38,253 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:38,253 - distributed.worker - INFO - dashboard at: 127.0.0.1:39115 2836s 2024-11-24 00:40:38,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42141 2836s 2024-11-24 00:40:38,253 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:38,254 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:38,254 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:38,254 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cs46wk0x 2836s 2024-11-24 00:40:38,254 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:38,254 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32977. Reason: failure-to-start- 2836s 2024-11-24 00:40:38,254 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:38,255 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32807. Reason: failure-to-start- 2836s 2024-11-24 00:40:38,255 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:38,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42141': TLS handshake failed with remote 'tls://127.0.0.1:52534': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:38,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42141': TLS handshake failed with remote 'tls://127.0.0.1:52538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:38,257 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:39,262 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:39,265 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40973 2836s 2024-11-24 00:40:39,265 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37721/status 2836s 2024-11-24 00:40:39,265 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:39,272 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37139 2836s 2024-11-24 00:40:39,272 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37139 2836s 2024-11-24 00:40:39,272 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:39,272 - distributed.worker - INFO - dashboard at: 127.0.0.1:46175 2836s 2024-11-24 00:40:39,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40973 2836s 2024-11-24 00:40:39,272 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:39,272 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:39,273 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:39,273 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w138svw9 2836s 2024-11-24 00:40:39,273 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:39,274 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34277 2836s 2024-11-24 00:40:39,274 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34277 2836s 2024-11-24 00:40:39,274 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:39,274 - distributed.worker - INFO - dashboard at: 127.0.0.1:41165 2836s 2024-11-24 00:40:39,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40973 2836s 2024-11-24 00:40:39,274 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:39,274 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:39,274 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:39,274 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8fie_bey 2836s 2024-11-24 00:40:39,274 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:39,275 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37139. Reason: failure-to-start- 2836s 2024-11-24 00:40:39,275 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:39,276 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34277. Reason: failure-to-start- 2836s 2024-11-24 00:40:39,276 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:39,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40973': TLS handshake failed with remote 'tls://127.0.0.1:38832': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:39,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40973': TLS handshake failed with remote 'tls://127.0.0.1:38836': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:39,278 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:40,282 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:40,287 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46203 2836s 2024-11-24 00:40:40,287 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39667/status 2836s 2024-11-24 00:40:40,287 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:40,295 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36141 2836s 2024-11-24 00:40:40,295 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36141 2836s 2024-11-24 00:40:40,295 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:40,295 - distributed.worker - INFO - dashboard at: 127.0.0.1:39393 2836s 2024-11-24 00:40:40,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46203 2836s 2024-11-24 00:40:40,295 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:40,295 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:40,295 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:40,295 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hh7zi8mg 2836s 2024-11-24 00:40:40,295 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:40,297 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36711 2836s 2024-11-24 00:40:40,297 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36711 2836s 2024-11-24 00:40:40,297 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:40,297 - distributed.worker - INFO - dashboard at: 127.0.0.1:36865 2836s 2024-11-24 00:40:40,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46203 2836s 2024-11-24 00:40:40,297 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:40,297 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:40,297 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:40,297 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b7h0nmww 2836s 2024-11-24 00:40:40,297 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:40,298 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36141. Reason: failure-to-start- 2836s 2024-11-24 00:40:40,298 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:40,298 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36711. Reason: failure-to-start- 2836s 2024-11-24 00:40:40,298 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:40,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46203': TLS handshake failed with remote 'tls://127.0.0.1:57212': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:40,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46203': TLS handshake failed with remote 'tls://127.0.0.1:57226': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:40,301 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:41,306 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:41,309 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34373 2836s 2024-11-24 00:40:41,310 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35201/status 2836s 2024-11-24 00:40:41,310 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:41,319 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39043 2836s 2024-11-24 00:40:41,319 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39043 2836s 2024-11-24 00:40:41,319 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:41,319 - distributed.worker - INFO - dashboard at: 127.0.0.1:34863 2836s 2024-11-24 00:40:41,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34373 2836s 2024-11-24 00:40:41,319 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:41,319 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:41,319 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:41,319 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-exk3cd56 2836s 2024-11-24 00:40:41,319 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:41,321 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45479 2836s 2024-11-24 00:40:41,321 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45479 2836s 2024-11-24 00:40:41,321 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:41,321 - distributed.worker - INFO - dashboard at: 127.0.0.1:38159 2836s 2024-11-24 00:40:41,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34373 2836s 2024-11-24 00:40:41,321 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:41,321 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:41,321 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:41,321 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1ue1f4uf 2836s 2024-11-24 00:40:41,321 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:41,322 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39043. Reason: failure-to-start- 2836s 2024-11-24 00:40:41,322 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:41,323 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45479. Reason: failure-to-start- 2836s 2024-11-24 00:40:41,323 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:41,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34373': TLS handshake failed with remote 'tls://127.0.0.1:59486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:41,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34373': TLS handshake failed with remote 'tls://127.0.0.1:59496': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:41,325 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:42,330 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:42,333 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33011 2836s 2024-11-24 00:40:42,334 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40975/status 2836s 2024-11-24 00:40:42,334 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:42,341 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44027 2836s 2024-11-24 00:40:42,342 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44027 2836s 2024-11-24 00:40:42,342 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:42,342 - distributed.worker - INFO - dashboard at: 127.0.0.1:44561 2836s 2024-11-24 00:40:42,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33011 2836s 2024-11-24 00:40:42,342 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:42,342 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:42,342 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:42,342 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ng5qo45b 2836s 2024-11-24 00:40:42,342 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:42,344 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40655 2836s 2024-11-24 00:40:42,344 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40655 2836s 2024-11-24 00:40:42,344 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:42,344 - distributed.worker - INFO - dashboard at: 127.0.0.1:46783 2836s 2024-11-24 00:40:42,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33011 2836s 2024-11-24 00:40:42,345 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:42,345 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:42,345 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:42,345 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_am9zc_a 2836s 2024-11-24 00:40:42,345 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:42,346 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44027. Reason: failure-to-start- 2836s 2024-11-24 00:40:42,346 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:42,346 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40655. Reason: failure-to-start- 2836s 2024-11-24 00:40:42,347 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:42,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33011': TLS handshake failed with remote 'tls://127.0.0.1:46698': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:42,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33011': TLS handshake failed with remote 'tls://127.0.0.1:46700': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:42,349 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:43,354 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:43,357 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43657 2836s 2024-11-24 00:40:43,357 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36145/status 2836s 2024-11-24 00:40:43,358 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:43,365 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36515 2836s 2024-11-24 00:40:43,366 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36515 2836s 2024-11-24 00:40:43,366 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:43,366 - distributed.worker - INFO - dashboard at: 127.0.0.1:43367 2836s 2024-11-24 00:40:43,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43657 2836s 2024-11-24 00:40:43,366 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:43,366 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:43,366 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:43,366 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7i6n29si 2836s 2024-11-24 00:40:43,366 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:43,368 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36363 2836s 2024-11-24 00:40:43,368 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36363 2836s 2024-11-24 00:40:43,368 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:43,368 - distributed.worker - INFO - dashboard at: 127.0.0.1:40321 2836s 2024-11-24 00:40:43,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43657 2836s 2024-11-24 00:40:43,368 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:43,368 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:43,368 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:43,368 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lunqo7jo 2836s 2024-11-24 00:40:43,368 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:43,369 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36515. Reason: failure-to-start- 2836s 2024-11-24 00:40:43,369 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:43,369 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36363. Reason: failure-to-start- 2836s 2024-11-24 00:40:43,369 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:43,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43657': TLS handshake failed with remote 'tls://127.0.0.1:34092': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:43,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43657': TLS handshake failed with remote 'tls://127.0.0.1:34096': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:43,372 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:44,376 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:44,380 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33593 2836s 2024-11-24 00:40:44,380 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40653/status 2836s 2024-11-24 00:40:44,380 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:44,389 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35061 2836s 2024-11-24 00:40:44,389 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35061 2836s 2024-11-24 00:40:44,389 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:44,389 - distributed.worker - INFO - dashboard at: 127.0.0.1:40163 2836s 2024-11-24 00:40:44,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33593 2836s 2024-11-24 00:40:44,389 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:44,389 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:44,389 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:44,389 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ine81pey 2836s 2024-11-24 00:40:44,389 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:44,391 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46845 2836s 2024-11-24 00:40:44,391 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46845 2836s 2024-11-24 00:40:44,391 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:44,391 - distributed.worker - INFO - dashboard at: 127.0.0.1:43335 2836s 2024-11-24 00:40:44,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33593 2836s 2024-11-24 00:40:44,391 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:44,391 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:44,391 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:44,391 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oj_j_s1o 2836s 2024-11-24 00:40:44,391 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:44,392 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35061. Reason: failure-to-start- 2836s 2024-11-24 00:40:44,392 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:44,393 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46845. Reason: failure-to-start- 2836s 2024-11-24 00:40:44,393 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:44,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33593': TLS handshake failed with remote 'tls://127.0.0.1:39470': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:44,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33593': TLS handshake failed with remote 'tls://127.0.0.1:39482': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:44,395 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:45,400 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:45,405 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46389 2836s 2024-11-24 00:40:45,406 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38039/status 2836s 2024-11-24 00:40:45,406 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:45,414 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39775 2836s 2024-11-24 00:40:45,414 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39775 2836s 2024-11-24 00:40:45,414 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:45,415 - distributed.worker - INFO - dashboard at: 127.0.0.1:43747 2836s 2024-11-24 00:40:45,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46389 2836s 2024-11-24 00:40:45,415 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:45,415 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:45,415 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:45,415 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nk2j33e1 2836s 2024-11-24 00:40:45,415 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:45,416 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33123 2836s 2024-11-24 00:40:45,416 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33123 2836s 2024-11-24 00:40:45,417 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:45,417 - distributed.worker - INFO - dashboard at: 127.0.0.1:40921 2836s 2024-11-24 00:40:45,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46389 2836s 2024-11-24 00:40:45,417 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:45,417 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:45,417 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:45,417 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cdaoh2n5 2836s 2024-11-24 00:40:45,417 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:45,418 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39775. Reason: failure-to-start- 2836s 2024-11-24 00:40:45,418 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:45,418 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33123. Reason: failure-to-start- 2836s 2024-11-24 00:40:45,418 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:45,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46389': TLS handshake failed with remote 'tls://127.0.0.1:58674': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:45,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46389': TLS handshake failed with remote 'tls://127.0.0.1:58684': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:45,421 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:46,425 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:46,429 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36847 2836s 2024-11-24 00:40:46,429 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44425/status 2836s 2024-11-24 00:40:46,430 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:46,440 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37621 2836s 2024-11-24 00:40:46,440 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37621 2836s 2024-11-24 00:40:46,440 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:46,440 - distributed.worker - INFO - dashboard at: 127.0.0.1:38701 2836s 2024-11-24 00:40:46,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36847 2836s 2024-11-24 00:40:46,440 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:46,440 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:46,440 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:46,440 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6mw7sdwa 2836s 2024-11-24 00:40:46,440 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:46,442 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41927 2836s 2024-11-24 00:40:46,442 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41927 2836s 2024-11-24 00:40:46,442 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:46,442 - distributed.worker - INFO - dashboard at: 127.0.0.1:43123 2836s 2024-11-24 00:40:46,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36847 2836s 2024-11-24 00:40:46,442 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:46,442 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:46,442 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:46,442 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_qcrw6ed 2836s 2024-11-24 00:40:46,442 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:46,443 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37621. Reason: failure-to-start- 2836s 2024-11-24 00:40:46,443 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:46,444 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41927. Reason: failure-to-start- 2836s 2024-11-24 00:40:46,444 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:46,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36847': TLS handshake failed with remote 'tls://127.0.0.1:45238': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:46,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36847': TLS handshake failed with remote 'tls://127.0.0.1:45248': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:46,447 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:47,452 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:47,455 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42687 2836s 2024-11-24 00:40:47,456 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41421/status 2836s 2024-11-24 00:40:47,456 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:47,464 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43289 2836s 2024-11-24 00:40:47,464 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43289 2836s 2024-11-24 00:40:47,464 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:47,464 - distributed.worker - INFO - dashboard at: 127.0.0.1:33181 2836s 2024-11-24 00:40:47,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42687 2836s 2024-11-24 00:40:47,464 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:47,464 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:47,464 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:47,465 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fxdm5qvk 2836s 2024-11-24 00:40:47,465 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:47,467 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38771 2836s 2024-11-24 00:40:47,467 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38771 2836s 2024-11-24 00:40:47,467 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:47,467 - distributed.worker - INFO - dashboard at: 127.0.0.1:41713 2836s 2024-11-24 00:40:47,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42687 2836s 2024-11-24 00:40:47,467 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:47,468 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:47,468 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:47,468 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p9fuujw9 2836s 2024-11-24 00:40:47,468 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:47,469 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43289. Reason: failure-to-start- 2836s 2024-11-24 00:40:47,469 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:47,469 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38771. Reason: failure-to-start- 2836s 2024-11-24 00:40:47,469 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:47,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42687': TLS handshake failed with remote 'tls://127.0.0.1:46498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:47,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42687': TLS handshake failed with remote 'tls://127.0.0.1:46500': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:47,472 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:48,477 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:48,481 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44113 2836s 2024-11-24 00:40:48,481 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45125/status 2836s 2024-11-24 00:40:48,481 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:48,490 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40271 2836s 2024-11-24 00:40:48,490 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40271 2836s 2024-11-24 00:40:48,490 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:48,490 - distributed.worker - INFO - dashboard at: 127.0.0.1:33405 2836s 2024-11-24 00:40:48,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44113 2836s 2024-11-24 00:40:48,490 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:48,490 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:48,490 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:48,490 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-09bruoca 2836s 2024-11-24 00:40:48,490 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:48,492 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36149 2836s 2024-11-24 00:40:48,492 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36149 2836s 2024-11-24 00:40:48,492 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:48,492 - distributed.worker - INFO - dashboard at: 127.0.0.1:44967 2836s 2024-11-24 00:40:48,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44113 2836s 2024-11-24 00:40:48,492 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:48,492 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:48,492 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:48,492 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jw0iv3wy 2836s 2024-11-24 00:40:48,492 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:48,493 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40271. Reason: failure-to-start- 2836s 2024-11-24 00:40:48,493 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:48,494 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36149. Reason: failure-to-start- 2836s 2024-11-24 00:40:48,494 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:48,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44113': TLS handshake failed with remote 'tls://127.0.0.1:44362': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:48,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44113': TLS handshake failed with remote 'tls://127.0.0.1:44372': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:48,496 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:49,501 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:49,505 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46147 2836s 2024-11-24 00:40:49,505 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34073/status 2836s 2024-11-24 00:40:49,506 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:49,515 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35049 2836s 2024-11-24 00:40:49,515 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35049 2836s 2024-11-24 00:40:49,515 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:49,515 - distributed.worker - INFO - dashboard at: 127.0.0.1:42555 2836s 2024-11-24 00:40:49,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46147 2836s 2024-11-24 00:40:49,515 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:49,516 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:49,516 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:49,516 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ubq1lhqo 2836s 2024-11-24 00:40:49,516 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:49,517 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35903 2836s 2024-11-24 00:40:49,518 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35903 2836s 2024-11-24 00:40:49,518 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:49,518 - distributed.worker - INFO - dashboard at: 127.0.0.1:39907 2836s 2024-11-24 00:40:49,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46147 2836s 2024-11-24 00:40:49,518 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:49,518 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:49,518 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:49,518 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z92ptxc_ 2836s 2024-11-24 00:40:49,518 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:49,519 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35049. Reason: failure-to-start- 2836s 2024-11-24 00:40:49,519 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:49,519 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35903. Reason: failure-to-start- 2836s 2024-11-24 00:40:49,520 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:49,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46147': TLS handshake failed with remote 'tls://127.0.0.1:36984': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:49,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46147': TLS handshake failed with remote 'tls://127.0.0.1:36996': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:49,523 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:50,528 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:50,533 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43487 2836s 2024-11-24 00:40:50,533 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44925/status 2836s 2024-11-24 00:40:50,533 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:50,541 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41099 2836s 2024-11-24 00:40:50,541 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41099 2836s 2024-11-24 00:40:50,541 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:50,541 - distributed.worker - INFO - dashboard at: 127.0.0.1:44785 2836s 2024-11-24 00:40:50,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43487 2836s 2024-11-24 00:40:50,541 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:50,541 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:50,541 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:50,542 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8pws87tb 2836s 2024-11-24 00:40:50,542 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:50,543 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45999 2836s 2024-11-24 00:40:50,543 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45999 2836s 2024-11-24 00:40:50,543 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:50,543 - distributed.worker - INFO - dashboard at: 127.0.0.1:45215 2836s 2024-11-24 00:40:50,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43487 2836s 2024-11-24 00:40:50,544 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:50,544 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:50,544 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:50,544 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_d70fkad 2836s 2024-11-24 00:40:50,544 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:50,545 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41099. Reason: failure-to-start- 2836s 2024-11-24 00:40:50,545 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:50,545 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45999. Reason: failure-to-start- 2836s 2024-11-24 00:40:50,545 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:50,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43487': TLS handshake failed with remote 'tls://127.0.0.1:50656': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:50,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43487': TLS handshake failed with remote 'tls://127.0.0.1:50662': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:50,549 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:51,553 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:51,557 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39455 2836s 2024-11-24 00:40:51,557 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38959/status 2836s 2024-11-24 00:40:51,557 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:51,578 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39827 2836s 2024-11-24 00:40:51,578 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39827 2836s 2024-11-24 00:40:51,578 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:51,578 - distributed.worker - INFO - dashboard at: 127.0.0.1:45015 2836s 2024-11-24 00:40:51,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39455 2836s 2024-11-24 00:40:51,578 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:51,578 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:51,578 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:51,578 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-otd93e7m 2836s 2024-11-24 00:40:51,578 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:51,580 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34525 2836s 2024-11-24 00:40:51,580 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34525 2836s 2024-11-24 00:40:51,580 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:51,580 - distributed.worker - INFO - dashboard at: 127.0.0.1:42223 2836s 2024-11-24 00:40:51,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39455 2836s 2024-11-24 00:40:51,580 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:51,580 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:51,580 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:51,580 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dq0761ik 2836s 2024-11-24 00:40:51,580 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:51,582 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39827. Reason: failure-to-start- 2836s 2024-11-24 00:40:51,582 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:51,583 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34525. Reason: failure-to-start- 2836s 2024-11-24 00:40:51,583 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:51,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39455': TLS handshake failed with remote 'tls://127.0.0.1:39710': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:51,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39455': TLS handshake failed with remote 'tls://127.0.0.1:39720': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:51,587 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:52,591 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:52,595 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38695 2836s 2024-11-24 00:40:52,595 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41889/status 2836s 2024-11-24 00:40:52,595 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:52,604 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38999 2836s 2024-11-24 00:40:52,604 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38999 2836s 2024-11-24 00:40:52,604 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:52,604 - distributed.worker - INFO - dashboard at: 127.0.0.1:45605 2836s 2024-11-24 00:40:52,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38695 2836s 2024-11-24 00:40:52,604 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:52,604 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:52,604 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:52,604 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rmr0czvi 2836s 2024-11-24 00:40:52,604 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:52,607 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44137 2836s 2024-11-24 00:40:52,607 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44137 2836s 2024-11-24 00:40:52,607 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:52,607 - distributed.worker - INFO - dashboard at: 127.0.0.1:45837 2836s 2024-11-24 00:40:52,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38695 2836s 2024-11-24 00:40:52,607 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:52,607 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:52,607 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:52,607 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fb6nklde 2836s 2024-11-24 00:40:52,607 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:52,608 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38999. Reason: failure-to-start- 2836s 2024-11-24 00:40:52,609 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:52,609 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44137. Reason: failure-to-start- 2836s 2024-11-24 00:40:52,609 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:52,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38695': TLS handshake failed with remote 'tls://127.0.0.1:60566': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:52,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38695': TLS handshake failed with remote 'tls://127.0.0.1:60574': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:52,613 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:53,618 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:53,622 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34723 2836s 2024-11-24 00:40:53,622 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38259/status 2836s 2024-11-24 00:40:53,622 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:53,630 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40061 2836s 2024-11-24 00:40:53,631 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40061 2836s 2024-11-24 00:40:53,631 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:53,631 - distributed.worker - INFO - dashboard at: 127.0.0.1:36175 2836s 2024-11-24 00:40:53,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34723 2836s 2024-11-24 00:40:53,631 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:53,631 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:53,631 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:53,631 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6q42gv6w 2836s 2024-11-24 00:40:53,631 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:53,632 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43009 2836s 2024-11-24 00:40:53,633 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43009 2836s 2024-11-24 00:40:53,633 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:53,633 - distributed.worker - INFO - dashboard at: 127.0.0.1:35251 2836s 2024-11-24 00:40:53,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34723 2836s 2024-11-24 00:40:53,633 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:53,633 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:53,633 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:53,633 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e8l9pb8u 2836s 2024-11-24 00:40:53,633 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:53,635 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40061. Reason: failure-to-start- 2836s 2024-11-24 00:40:53,635 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:53,635 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43009. Reason: failure-to-start- 2836s 2024-11-24 00:40:53,635 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:53,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34723': TLS handshake failed with remote 'tls://127.0.0.1:57942': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:53,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34723': TLS handshake failed with remote 'tls://127.0.0.1:57946': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:53,638 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:54,644 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:54,648 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43277 2836s 2024-11-24 00:40:54,648 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42237/status 2836s 2024-11-24 00:40:54,648 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:54,657 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38499 2836s 2024-11-24 00:40:54,657 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38499 2836s 2024-11-24 00:40:54,657 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:54,657 - distributed.worker - INFO - dashboard at: 127.0.0.1:41645 2836s 2024-11-24 00:40:54,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43277 2836s 2024-11-24 00:40:54,657 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:54,657 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:54,657 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:54,658 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z4itblz_ 2836s 2024-11-24 00:40:54,658 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:54,659 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41069 2836s 2024-11-24 00:40:54,659 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41069 2836s 2024-11-24 00:40:54,659 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:54,659 - distributed.worker - INFO - dashboard at: 127.0.0.1:36103 2836s 2024-11-24 00:40:54,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43277 2836s 2024-11-24 00:40:54,660 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:54,660 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:54,660 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:54,660 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bhsg2lzk 2836s 2024-11-24 00:40:54,660 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:54,661 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38499. Reason: failure-to-start- 2836s 2024-11-24 00:40:54,662 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:54,662 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41069. Reason: failure-to-start- 2836s 2024-11-24 00:40:54,662 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:54,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43277': TLS handshake failed with remote 'tls://127.0.0.1:60432': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:54,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43277': TLS handshake failed with remote 'tls://127.0.0.1:60440': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:54,665 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:55,669 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:55,673 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34929 2836s 2024-11-24 00:40:55,673 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39445/status 2836s 2024-11-24 00:40:55,673 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:55,684 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45483 2836s 2024-11-24 00:40:55,684 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45483 2836s 2024-11-24 00:40:55,684 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:55,684 - distributed.worker - INFO - dashboard at: 127.0.0.1:33365 2836s 2024-11-24 00:40:55,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34929 2836s 2024-11-24 00:40:55,684 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:55,684 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:55,684 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:55,684 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hsf7p6gd 2836s 2024-11-24 00:40:55,684 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:55,686 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44621 2836s 2024-11-24 00:40:55,686 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44621 2836s 2024-11-24 00:40:55,686 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:55,686 - distributed.worker - INFO - dashboard at: 127.0.0.1:45153 2836s 2024-11-24 00:40:55,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34929 2836s 2024-11-24 00:40:55,686 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:55,686 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:55,686 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:55,686 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lih69d8a 2836s 2024-11-24 00:40:55,686 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:55,687 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45483. Reason: failure-to-start- 2836s 2024-11-24 00:40:55,687 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:55,687 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44621. Reason: failure-to-start- 2836s 2024-11-24 00:40:55,688 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:55,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34929': TLS handshake failed with remote 'tls://127.0.0.1:37630': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:55,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34929': TLS handshake failed with remote 'tls://127.0.0.1:37632': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:55,690 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:56,695 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:56,699 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46623 2836s 2024-11-24 00:40:56,699 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41643/status 2836s 2024-11-24 00:40:56,699 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:56,709 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38263 2836s 2024-11-24 00:40:56,709 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38263 2836s 2024-11-24 00:40:56,709 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:56,710 - distributed.worker - INFO - dashboard at: 127.0.0.1:33869 2836s 2024-11-24 00:40:56,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46623 2836s 2024-11-24 00:40:56,710 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:56,710 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:56,710 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:56,710 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8tcpkzst 2836s 2024-11-24 00:40:56,710 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:56,711 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35721 2836s 2024-11-24 00:40:56,711 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35721 2836s 2024-11-24 00:40:56,711 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:56,711 - distributed.worker - INFO - dashboard at: 127.0.0.1:41749 2836s 2024-11-24 00:40:56,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46623 2836s 2024-11-24 00:40:56,712 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:56,712 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:56,712 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:56,712 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xrxe4bt8 2836s 2024-11-24 00:40:56,712 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:56,713 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38263. Reason: failure-to-start- 2836s 2024-11-24 00:40:56,713 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:56,713 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35721. Reason: failure-to-start- 2836s 2024-11-24 00:40:56,713 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:56,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46623': TLS handshake failed with remote 'tls://127.0.0.1:52126': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:56,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46623': TLS handshake failed with remote 'tls://127.0.0.1:52136': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:56,715 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:40:57,720 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:40:57,724 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37023 2836s 2024-11-24 00:40:57,725 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34095/status 2836s 2024-11-24 00:40:57,725 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:40:57,735 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36397 2836s 2024-11-24 00:40:57,735 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36397 2836s 2024-11-24 00:40:57,735 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:40:57,735 - distributed.worker - INFO - dashboard at: 127.0.0.1:37927 2836s 2024-11-24 00:40:57,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37023 2836s 2024-11-24 00:40:57,735 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:57,735 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:40:57,736 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:57,736 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c_pk_x53 2836s 2024-11-24 00:40:57,736 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:57,737 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35207 2836s 2024-11-24 00:40:57,737 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35207 2836s 2024-11-24 00:40:57,738 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:40:57,738 - distributed.worker - INFO - dashboard at: 127.0.0.1:43425 2836s 2024-11-24 00:40:57,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37023 2836s 2024-11-24 00:40:57,738 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:57,738 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:40:57,738 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:40:57,738 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e9nabz07 2836s 2024-11-24 00:40:57,738 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:40:57,740 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36397. Reason: failure-to-start- 2836s 2024-11-24 00:40:57,740 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:57,741 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35207. Reason: failure-to-start- 2836s 2024-11-24 00:40:57,741 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:40:57,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37023': TLS handshake failed with remote 'tls://127.0.0.1:38674': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:57,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37023': TLS handshake failed with remote 'tls://127.0.0.1:38678': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:40:57,744 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s _____________________________ test_repr_temp_keys ______________________________ 2836s 2836s cls = , kwargs = {} 2836s 2836s @classmethod 2836s def temporary(cls, **kwargs): 2836s """Create a new temporary Security object. 2836s 2836s This creates a new self-signed key/cert pair suitable for securing 2836s communication for all roles in a Dask cluster. These keys/certs exist 2836s only in memory, and are stored in this object. 2836s 2836s This method requires the library ``cryptography`` be installed. 2836s """ 2836s try: 2836s > from cryptography import x509 2836s 2836s /usr/lib/python3/dist-packages/distributed/security.py:165: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 2836s from cryptography.x509 import certificate_transparency, verification 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s # This file is dual licensed under the terms of the Apache License, Version 2836s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 2836s # for complete details. 2836s 2836s from __future__ import annotations 2836s 2836s import abc 2836s import datetime 2836s 2836s from cryptography import utils 2836s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 2836s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 2836s 2836s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 2836s 2836s During handling of the above exception, another exception occurred: 2836s 2836s def test_repr_temp_keys(): 2836s > xfail_ssl_issue5601() 2836s 2836s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:155: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 2836s Security.temporary() 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s cls = , kwargs = {} 2836s 2836s @classmethod 2836s def temporary(cls, **kwargs): 2836s """Create a new temporary Security object. 2836s 2836s This creates a new self-signed key/cert pair suitable for securing 2836s communication for all roles in a Dask cluster. These keys/certs exist 2836s only in memory, and are stored in this object. 2836s 2836s This method requires the library ``cryptography`` be installed. 2836s """ 2836s try: 2836s from cryptography import x509 2836s from cryptography.hazmat.backends import default_backend 2836s from cryptography.hazmat.primitives import hashes, serialization 2836s from cryptography.hazmat.primitives.asymmetric import rsa 2836s from cryptography.x509.oid import NameOID 2836s except ImportError: 2836s > raise ImportError( 2836s "Using `Security.temporary` requires `cryptography`, please " 2836s "install it using either pip or conda" 2836s ) 2836s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 2836s 2836s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 2836s __________________________ test_temporary_credentials __________________________ 2836s 2836s cls = , kwargs = {} 2836s 2836s @classmethod 2836s def temporary(cls, **kwargs): 2836s """Create a new temporary Security object. 2836s 2836s This creates a new self-signed key/cert pair suitable for securing 2836s communication for all roles in a Dask cluster. These keys/certs exist 2836s only in memory, and are stored in this object. 2836s 2836s This method requires the library ``cryptography`` be installed. 2836s """ 2836s try: 2836s > from cryptography import x509 2836s 2836s /usr/lib/python3/dist-packages/distributed/security.py:165: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 2836s from cryptography.x509 import certificate_transparency, verification 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s # This file is dual licensed under the terms of the Apache License, Version 2836s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 2836s # for complete details. 2836s 2836s from __future__ import annotations 2836s 2836s import abc 2836s import datetime 2836s 2836s from cryptography import utils 2836s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 2836s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 2836s 2836s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 2836s 2836s During handling of the above exception, another exception occurred: 2836s 2836s def test_temporary_credentials(): 2836s > xfail_ssl_issue5601() 2836s 2836s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:448: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 2836s Security.temporary() 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s cls = , kwargs = {} 2836s 2836s @classmethod 2836s def temporary(cls, **kwargs): 2836s """Create a new temporary Security object. 2836s 2836s This creates a new self-signed key/cert pair suitable for securing 2836s communication for all roles in a Dask cluster. These keys/certs exist 2836s only in memory, and are stored in this object. 2836s 2836s This method requires the library ``cryptography`` be installed. 2836s """ 2836s try: 2836s from cryptography import x509 2836s from cryptography.hazmat.backends import default_backend 2836s from cryptography.hazmat.primitives import hashes, serialization 2836s from cryptography.hazmat.primitives.asymmetric import rsa 2836s from cryptography.x509.oid import NameOID 2836s except ImportError: 2836s > raise ImportError( 2836s "Using `Security.temporary` requires `cryptography`, please " 2836s "install it using either pip or conda" 2836s ) 2836s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 2836s 2836s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 2836s ________________ test_extra_conn_args_in_temporary_credentials _________________ 2836s 2836s cls = , kwargs = {} 2836s 2836s @classmethod 2836s def temporary(cls, **kwargs): 2836s """Create a new temporary Security object. 2836s 2836s This creates a new self-signed key/cert pair suitable for securing 2836s communication for all roles in a Dask cluster. These keys/certs exist 2836s only in memory, and are stored in this object. 2836s 2836s This method requires the library ``cryptography`` be installed. 2836s """ 2836s try: 2836s > from cryptography import x509 2836s 2836s /usr/lib/python3/dist-packages/distributed/security.py:165: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 2836s from cryptography.x509 import certificate_transparency, verification 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s # This file is dual licensed under the terms of the Apache License, Version 2836s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 2836s # for complete details. 2836s 2836s from __future__ import annotations 2836s 2836s import abc 2836s import datetime 2836s 2836s from cryptography import utils 2836s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 2836s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 2836s 2836s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 2836s 2836s During handling of the above exception, another exception occurred: 2836s 2836s def test_extra_conn_args_in_temporary_credentials(): 2836s > xfail_ssl_issue5601() 2836s 2836s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:466: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 2836s Security.temporary() 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s cls = , kwargs = {} 2836s 2836s @classmethod 2836s def temporary(cls, **kwargs): 2836s """Create a new temporary Security object. 2836s 2836s This creates a new self-signed key/cert pair suitable for securing 2836s communication for all roles in a Dask cluster. These keys/certs exist 2836s only in memory, and are stored in this object. 2836s 2836s This method requires the library ``cryptography`` be installed. 2836s """ 2836s try: 2836s from cryptography import x509 2836s from cryptography.hazmat.backends import default_backend 2836s from cryptography.hazmat.primitives import hashes, serialization 2836s from cryptography.hazmat.primitives.asymmetric import rsa 2836s from cryptography.x509.oid import NameOID 2836s except ImportError: 2836s > raise ImportError( 2836s "Using `Security.temporary` requires `cryptography`, please " 2836s "install it using either pip or conda" 2836s ) 2836s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 2836s 2836s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 2836s __________________________________ test_basic __________________________________ 2836s 2836s fut = , timeout = 0 2836s 2836s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2836s async with asyncio.timeout(timeout): 2836s > return await fut 2836s 2836s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 2836s await self._register_with_scheduler() 2836s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2836s comm = await wait_for( 2836s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2836s return await fut 2836s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 2836s stream = await self.client.connect( 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s host = '127.0.0.1', port = 41585, af = 2836s ssl_options = 2836s max_buffer_size = 4151066624.0, source_ip = None, source_port = None 2836s timeout = None 2836s 2836s async def connect( 2836s self, 2836s host: str, 2836s port: int, 2836s af: socket.AddressFamily = socket.AF_UNSPEC, 2836s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 2836s max_buffer_size: Optional[int] = None, 2836s source_ip: Optional[str] = None, 2836s source_port: Optional[int] = None, 2836s timeout: Optional[Union[float, datetime.timedelta]] = None, 2836s ) -> IOStream: 2836s """Connect to the given host and port. 2836s 2836s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 2836s ``ssl_options`` is not None). 2836s 2836s Using the ``source_ip`` kwarg, one can specify the source 2836s IP address to use when establishing the connection. 2836s In case the user needs to resolve and 2836s use a specific interface, it has to be handled outside 2836s of Tornado as this depends very much on the platform. 2836s 2836s Raises `TimeoutError` if the input future does not complete before 2836s ``timeout``, which may be specified in any form allowed by 2836s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 2836s relative to `.IOLoop.time`) 2836s 2836s Similarly, when the user requires a certain source port, it can 2836s be specified using the ``source_port`` arg. 2836s 2836s .. versionchanged:: 4.5 2836s Added the ``source_ip`` and ``source_port`` arguments. 2836s 2836s .. versionchanged:: 5.0 2836s Added the ``timeout`` argument. 2836s """ 2836s if timeout is not None: 2836s if isinstance(timeout, numbers.Real): 2836s timeout = IOLoop.current().time() + timeout 2836s elif isinstance(timeout, datetime.timedelta): 2836s timeout = IOLoop.current().time() + timeout.total_seconds() 2836s else: 2836s raise TypeError("Unsupported timeout %r" % timeout) 2836s if timeout is not None: 2836s addrinfo = await gen.with_timeout( 2836s timeout, self.resolver.resolve(host, port, af) 2836s ) 2836s else: 2836s addrinfo = await self.resolver.resolve(host, port, af) 2836s connector = _Connector( 2836s addrinfo, 2836s functools.partial( 2836s self._create_stream, 2836s max_buffer_size, 2836s source_ip=source_ip, 2836s source_port=source_port, 2836s ), 2836s ) 2836s > af, addr, stream = await connector.start(connect_timeout=timeout) 2836s E asyncio.exceptions.CancelledError 2836s 2836s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s self = 2836s 2836s @final 2836s async def start(self): 2836s async with self._startup_lock: 2836s if self.status == Status.failed: 2836s assert self.__startup_exc is not None 2836s raise self.__startup_exc 2836s elif self.status != Status.init: 2836s return self 2836s timeout = getattr(self, "death_timeout", None) 2836s 2836s async def _close_on_failure(exc: Exception) -> None: 2836s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2836s self.status = Status.failed 2836s self.__startup_exc = exc 2836s 2836s try: 2836s > await wait_for(self.start_unsafe(), timeout=timeout) 2836s 2836s /usr/lib/python3/dist-packages/distributed/core.py:664: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2836s async with asyncio.timeout(timeout): 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s exc_type = 2836s exc_val = CancelledError(), exc_tb = 2836s 2836s async def __aexit__( 2836s self, 2836s exc_type: Optional[Type[BaseException]], 2836s exc_val: Optional[BaseException], 2836s exc_tb: Optional[TracebackType], 2836s ) -> Optional[bool]: 2836s assert self._state in (_State.ENTERED, _State.EXPIRING) 2836s 2836s if self._timeout_handler is not None: 2836s self._timeout_handler.cancel() 2836s self._timeout_handler = None 2836s 2836s if self._state is _State.EXPIRING: 2836s self._state = _State.EXPIRED 2836s 2836s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2836s # Since there are no new cancel requests, we're 2836s # handling this. 2836s if issubclass(exc_type, exceptions.CancelledError): 2836s > raise TimeoutError from exc_val 2836s E TimeoutError 2836s 2836s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s @contextlib.asynccontextmanager 2836s async def _cluster_factory(): 2836s workers = [] 2836s s = None 2836s try: 2836s for _ in range(60): 2836s try: 2836s > s, ws = await start_cluster( 2836s nthreads, 2836s scheduler, 2836s security=security, 2836s Worker=Worker, 2836s scheduler_kwargs=scheduler_kwargs, 2836s worker_kwargs=merge( 2836s {"death_timeout": min(15, int(deadline.remaining))}, 2836s worker_kwargs, 2836s ), 2836s ) 2836s 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 2836s await asyncio.gather(*workers) 2836s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 2836s return await awaitable 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s 2836s @final 2836s async def start(self): 2836s async with self._startup_lock: 2836s if self.status == Status.failed: 2836s assert self.__startup_exc is not None 2836s raise self.__startup_exc 2836s elif self.status != Status.init: 2836s return self 2836s timeout = getattr(self, "death_timeout", None) 2836s 2836s async def _close_on_failure(exc: Exception) -> None: 2836s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2836s self.status = Status.failed 2836s self.__startup_exc = exc 2836s 2836s try: 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s except asyncio.TimeoutError as exc: 2836s await _close_on_failure(exc) 2836s > raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s E TimeoutError: Worker start timed out after 0s. 2836s 2836s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 2836s 2836s During handling of the above exception, another exception occurred: 2836s 2836s fut = ._..test_func..async_fn at 0xe63f7717b300> 2836s timeout = 60 2836s 2836s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2836s async with asyncio.timeout(timeout): 2836s > return await fut 2836s 2836s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 2836s _cluster_factory() as (s, workers), 2836s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 2836s return await anext(self.gen) 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 2836s await asyncio.sleep(1) 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s delay = 1, result = None 2836s 2836s async def sleep(delay, result=None): 2836s """Coroutine that completes after a given time (in seconds).""" 2836s if delay <= 0: 2836s await __sleep0() 2836s return result 2836s 2836s if math.isnan(delay): 2836s raise ValueError("Invalid delay: NaN (not a number)") 2836s 2836s loop = events.get_running_loop() 2836s future = loop.create_future() 2836s h = loop.call_later(delay, 2836s futures._set_result_unless_cancelled, 2836s future, result) 2836s try: 2836s > return await future 2836s E asyncio.exceptions.CancelledError 2836s 2836s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s args = (), kwds = {} 2836s 2836s @wraps(func) 2836s def inner(*args, **kwds): 2836s with self._recreate_cm(): 2836s > return func(*args, **kwds) 2836s 2836s /usr/lib/python3.13/contextlib.py:85: 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s /usr/lib/python3.13/contextlib.py:85: in inner 2836s return func(*args, **kwds) 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 2836s return _run_and_close_tornado(async_fn_outer) 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 2836s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 2836s /usr/lib/python3.13/asyncio/runners.py:194: in run 2836s return runner.run(main) 2836s /usr/lib/python3.13/asyncio/runners.py:118: in run 2836s return self._loop.run_until_complete(task) 2836s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 2836s return future.result() 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 2836s return await async_fn(*args, **kwargs) 2836s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 2836s return await utils_wait_for(async_fn(), timeout=timeout * 2) 2836s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2836s async with asyncio.timeout(timeout): 2836s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2836s 2836s self = 2836s exc_type = 2836s exc_val = CancelledError(), exc_tb = 2836s 2836s async def __aexit__( 2836s self, 2836s exc_type: Optional[Type[BaseException]], 2836s exc_val: Optional[BaseException], 2836s exc_tb: Optional[TracebackType], 2836s ) -> Optional[bool]: 2836s assert self._state in (_State.ENTERED, _State.EXPIRING) 2836s 2836s if self._timeout_handler is not None: 2836s self._timeout_handler.cancel() 2836s self._timeout_handler = None 2836s 2836s if self._state is _State.EXPIRING: 2836s self._state = _State.EXPIRED 2836s 2836s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2836s # Since there are no new cancel requests, we're 2836s # handling this. 2836s if issubclass(exc_type, exceptions.CancelledError): 2836s > raise TimeoutError from exc_val 2836s E TimeoutError 2836s 2836s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2836s ----------------------------- Captured stderr call ----------------------------- 2836s 2024-11-24 00:43:27,624 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:43:27,628 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:27,628 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39867/status 2836s 2024-11-24 00:43:27,628 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:43:27,639 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36983 2836s 2024-11-24 00:43:27,639 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36983 2836s 2024-11-24 00:43:27,639 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:43:27,639 - distributed.worker - INFO - dashboard at: 127.0.0.1:37863 2836s 2024-11-24 00:43:27,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:27,639 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:27,640 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:43:27,640 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:43:27,640 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1tgdrmoy 2836s 2024-11-24 00:43:27,640 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:27,641 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44903 2836s 2024-11-24 00:43:27,641 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44903 2836s 2024-11-24 00:43:27,641 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:43:27,641 - distributed.worker - INFO - dashboard at: 127.0.0.1:36785 2836s 2024-11-24 00:43:27,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:27,641 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:27,641 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:43:27,642 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:43:27,642 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jg_qvsst 2836s 2024-11-24 00:43:27,642 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:27,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:27,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:27,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:27,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:27,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:27,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:27,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:27,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:27,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:27,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:27,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:27,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:27,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:27,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:27,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:27,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:28,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:28,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:29,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:29,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:30,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:30,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:30,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:30,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:30,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:30,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:30,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:30,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:30,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:30,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:30,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:30,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:30,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:30,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:30,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:30,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:30,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:30,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:30,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:30,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:30,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:30,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:30,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:30,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:30,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:30,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:30,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:30,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:30,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:30,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:30,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:30,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:33996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:31,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:31,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:32,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:32,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:33,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:33,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:34,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:34,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:34554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:35,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:35,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:36,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:36,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:37,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:37,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:38,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:38,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:39,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:39,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:41986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:40,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:40,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:41,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:41,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:42,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:42,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:42,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:42,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:42,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:42,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:42,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:42,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:42,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:42,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:42,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:42,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:42,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:42,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:42,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:42,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:42,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:42,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:42,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:42,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:42,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:42,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 2836s 2024-11-24 00:43:42,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:42,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:42360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:42,639 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36983. Reason: failure-to-start- 2836s 2024-11-24 00:43:42,639 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:43:42,640 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2836s stream = await stream.start_tls( 2836s ^^^^^^^^^^^^^^^^^^^^^^^ 2836s False, ssl_options=ssl_options, server_hostname=host 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2836s self.socket.do_handshake() 2836s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2836s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2836s self._sslobj.do_handshake() 2836s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2836s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2836s raise FatalCommClosedError( 2836s ...<2 lines>... 2836s ) from err 2836s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2836s 2836s During handling of the above exception, another exception occurred: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2836s await asyncio.sleep(0.1) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2836s return await future 2836s ^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 15s. 2836s 2024-11-24 00:43:42,643 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44903. Reason: failure-to-start- 2836s 2024-11-24 00:43:42,643 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:43:43,646 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:43:43,649 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:43,649 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35169/status 2836s 2024-11-24 00:43:43,650 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:43:43,658 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36465 2836s 2024-11-24 00:43:43,658 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36465 2836s 2024-11-24 00:43:43,658 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:43:43,658 - distributed.worker - INFO - dashboard at: 127.0.0.1:46063 2836s 2024-11-24 00:43:43,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:43,658 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:43,658 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:43:43,658 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:43:43,658 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2jcy0kxz 2836s 2024-11-24 00:43:43,658 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:43,659 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34303 2836s 2024-11-24 00:43:43,660 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34303 2836s 2024-11-24 00:43:43,660 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:43:43,660 - distributed.worker - INFO - dashboard at: 127.0.0.1:44457 2836s 2024-11-24 00:43:43,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:43,660 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:43,660 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:43:43,660 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:43:43,660 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ewxthdmt 2836s 2024-11-24 00:43:43,660 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:43,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:43,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:43,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:43,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:43,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:43,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:43,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:43,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:43,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:43,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:43,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:43,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:44,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:44,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:45,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:45,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:46,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:46,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:57996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:47,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:47,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:48,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:48,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:49,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:49,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:50,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:50,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:51,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:51,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:52,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:52,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:58990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:53,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:53,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:54,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:54,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:59300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:55,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:55,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:56,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:56,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:56,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:56,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:56,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:56,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:56,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:56,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:56,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:56,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:56,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:56,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:56,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:56,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:56,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:56,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:56,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:56,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:56,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:56,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:56,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:56,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:56,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 2836s 2024-11-24 00:43:56,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2836s 2024-11-24 00:43:56,657 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36465. Reason: failure-to-start- 2836s 2024-11-24 00:43:56,657 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:43:56,658 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2836s stream = await stream.start_tls( 2836s ^^^^^^^^^^^^^^^^^^^^^^^ 2836s False, ssl_options=ssl_options, server_hostname=host 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2836s self.socket.do_handshake() 2836s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2836s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2836s self._sslobj.do_handshake() 2836s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2836s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2836s raise FatalCommClosedError( 2836s ...<2 lines>... 2836s ) from err 2836s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2836s 2836s During handling of the above exception, another exception occurred: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2836s await asyncio.sleep(0.1) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2836s return await future 2836s ^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 13s. 2836s 2024-11-24 00:43:56,662 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34303. Reason: failure-to-start- 2836s 2024-11-24 00:43:56,662 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:43:57,668 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:43:57,672 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38373 2836s 2024-11-24 00:43:57,672 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33325/status 2836s 2024-11-24 00:43:57,672 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:43:57,680 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41699 2836s 2024-11-24 00:43:57,680 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41699 2836s 2024-11-24 00:43:57,680 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:43:57,680 - distributed.worker - INFO - dashboard at: 127.0.0.1:38529 2836s 2024-11-24 00:43:57,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38373 2836s 2024-11-24 00:43:57,680 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:57,680 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:43:57,680 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:43:57,681 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ictsaygq 2836s 2024-11-24 00:43:57,681 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:57,682 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42899 2836s 2024-11-24 00:43:57,682 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42899 2836s 2024-11-24 00:43:57,682 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:43:57,682 - distributed.worker - INFO - dashboard at: 127.0.0.1:46589 2836s 2024-11-24 00:43:57,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38373 2836s 2024-11-24 00:43:57,683 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:57,683 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:43:57,683 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:43:57,683 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lw3rrp62 2836s 2024-11-24 00:43:57,683 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:57,684 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41699. Reason: failure-to-start- 2836s 2024-11-24 00:43:57,684 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:43:57,684 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42899. Reason: failure-to-start- 2836s 2024-11-24 00:43:57,684 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:43:57,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38373': TLS handshake failed with remote 'tls://127.0.0.1:58402': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:43:57,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38373': TLS handshake failed with remote 'tls://127.0.0.1:58418': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:43:57,686 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:43:58,691 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:43:58,694 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41253 2836s 2024-11-24 00:43:58,695 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32863/status 2836s 2024-11-24 00:43:58,695 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:43:58,704 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35545 2836s 2024-11-24 00:43:58,704 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35545 2836s 2024-11-24 00:43:58,704 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:43:58,704 - distributed.worker - INFO - dashboard at: 127.0.0.1:41975 2836s 2024-11-24 00:43:58,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41253 2836s 2024-11-24 00:43:58,704 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:58,704 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:43:58,704 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:43:58,704 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fe6kfbl6 2836s 2024-11-24 00:43:58,704 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:58,706 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32803 2836s 2024-11-24 00:43:58,706 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32803 2836s 2024-11-24 00:43:58,706 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:43:58,706 - distributed.worker - INFO - dashboard at: 127.0.0.1:42411 2836s 2024-11-24 00:43:58,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41253 2836s 2024-11-24 00:43:58,706 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:58,706 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:43:58,706 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:43:58,706 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-run3ap8p 2836s 2024-11-24 00:43:58,706 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:58,707 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35545. Reason: failure-to-start- 2836s 2024-11-24 00:43:58,707 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:43:58,707 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32803. Reason: failure-to-start- 2836s 2024-11-24 00:43:58,707 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:43:58,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41253': TLS handshake failed with remote 'tls://127.0.0.1:39946': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:43:58,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41253': TLS handshake failed with remote 'tls://127.0.0.1:39952': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:43:58,709 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:43:59,714 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:43:59,717 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37867 2836s 2024-11-24 00:43:59,717 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45129/status 2836s 2024-11-24 00:43:59,717 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:43:59,724 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34919 2836s 2024-11-24 00:43:59,725 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34919 2836s 2024-11-24 00:43:59,725 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:43:59,725 - distributed.worker - INFO - dashboard at: 127.0.0.1:37103 2836s 2024-11-24 00:43:59,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37867 2836s 2024-11-24 00:43:59,725 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:59,725 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:43:59,725 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:43:59,725 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gzgzyxrr 2836s 2024-11-24 00:43:59,725 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:59,727 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41121 2836s 2024-11-24 00:43:59,727 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41121 2836s 2024-11-24 00:43:59,727 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:43:59,727 - distributed.worker - INFO - dashboard at: 127.0.0.1:33819 2836s 2024-11-24 00:43:59,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37867 2836s 2024-11-24 00:43:59,727 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:59,727 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:43:59,728 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:43:59,728 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z3mrcce1 2836s 2024-11-24 00:43:59,728 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:43:59,728 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34919. Reason: failure-to-start- 2836s 2024-11-24 00:43:59,728 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:43:59,729 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41121. Reason: failure-to-start- 2836s 2024-11-24 00:43:59,729 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:43:59,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37867': TLS handshake failed with remote 'tls://127.0.0.1:51730': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:43:59,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37867': TLS handshake failed with remote 'tls://127.0.0.1:51734': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:43:59,731 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:00,735 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:00,738 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37369 2836s 2024-11-24 00:44:00,739 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46201/status 2836s 2024-11-24 00:44:00,739 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:00,746 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37453 2836s 2024-11-24 00:44:00,746 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37453 2836s 2024-11-24 00:44:00,746 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:00,746 - distributed.worker - INFO - dashboard at: 127.0.0.1:42573 2836s 2024-11-24 00:44:00,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37369 2836s 2024-11-24 00:44:00,747 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:00,747 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:00,747 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:00,747 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-clntlsbu 2836s 2024-11-24 00:44:00,747 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:00,748 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37847 2836s 2024-11-24 00:44:00,748 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37847 2836s 2024-11-24 00:44:00,748 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:00,748 - distributed.worker - INFO - dashboard at: 127.0.0.1:45213 2836s 2024-11-24 00:44:00,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37369 2836s 2024-11-24 00:44:00,749 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:00,749 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:00,749 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:00,749 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ea143ew9 2836s 2024-11-24 00:44:00,749 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:00,749 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37453. Reason: failure-to-start- 2836s 2024-11-24 00:44:00,750 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:00,750 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37847. Reason: failure-to-start- 2836s 2024-11-24 00:44:00,750 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:00,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37369': TLS handshake failed with remote 'tls://127.0.0.1:47694': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:00,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37369': TLS handshake failed with remote 'tls://127.0.0.1:47708': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:00,752 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:01,756 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:01,761 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35449 2836s 2024-11-24 00:44:01,761 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35899/status 2836s 2024-11-24 00:44:01,761 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:01,769 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34791 2836s 2024-11-24 00:44:01,769 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34791 2836s 2024-11-24 00:44:01,769 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:01,769 - distributed.worker - INFO - dashboard at: 127.0.0.1:35709 2836s 2024-11-24 00:44:01,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35449 2836s 2024-11-24 00:44:01,769 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:01,769 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:01,769 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:01,769 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fvgjxnzk 2836s 2024-11-24 00:44:01,769 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:01,771 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37501 2836s 2024-11-24 00:44:01,771 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37501 2836s 2024-11-24 00:44:01,771 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:01,771 - distributed.worker - INFO - dashboard at: 127.0.0.1:34913 2836s 2024-11-24 00:44:01,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35449 2836s 2024-11-24 00:44:01,771 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:01,771 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:01,771 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:01,771 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1yrmyn1o 2836s 2024-11-24 00:44:01,771 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:01,772 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34791. Reason: failure-to-start- 2836s 2024-11-24 00:44:01,772 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:01,772 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37501. Reason: failure-to-start- 2836s 2024-11-24 00:44:01,772 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:01,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35449': TLS handshake failed with remote 'tls://127.0.0.1:58596': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:01,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35449': TLS handshake failed with remote 'tls://127.0.0.1:58606': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:01,774 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:02,779 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:02,783 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39087 2836s 2024-11-24 00:44:02,783 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40993/status 2836s 2024-11-24 00:44:02,784 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:02,792 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34647 2836s 2024-11-24 00:44:02,792 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34647 2836s 2024-11-24 00:44:02,792 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:02,793 - distributed.worker - INFO - dashboard at: 127.0.0.1:35591 2836s 2024-11-24 00:44:02,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39087 2836s 2024-11-24 00:44:02,793 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:02,793 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:02,793 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:02,793 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0sb6rro3 2836s 2024-11-24 00:44:02,793 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:02,794 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41421 2836s 2024-11-24 00:44:02,794 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41421 2836s 2024-11-24 00:44:02,794 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:02,794 - distributed.worker - INFO - dashboard at: 127.0.0.1:41823 2836s 2024-11-24 00:44:02,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39087 2836s 2024-11-24 00:44:02,795 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:02,795 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:02,795 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:02,795 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h7t4hjkb 2836s 2024-11-24 00:44:02,795 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:02,795 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34647. Reason: failure-to-start- 2836s 2024-11-24 00:44:02,796 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:02,796 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41421. Reason: failure-to-start- 2836s 2024-11-24 00:44:02,796 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:02,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39087': TLS handshake failed with remote 'tls://127.0.0.1:51726': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:02,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39087': TLS handshake failed with remote 'tls://127.0.0.1:51740': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:02,798 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:03,802 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:03,806 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39701 2836s 2024-11-24 00:44:03,806 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39915/status 2836s 2024-11-24 00:44:03,806 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:03,814 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33415 2836s 2024-11-24 00:44:03,814 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33415 2836s 2024-11-24 00:44:03,814 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:03,817 - distributed.worker - INFO - dashboard at: 127.0.0.1:38175 2836s 2024-11-24 00:44:03,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39701 2836s 2024-11-24 00:44:03,818 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:03,818 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:03,818 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:03,818 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hcyarmz8 2836s 2024-11-24 00:44:03,818 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:03,820 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37375 2836s 2024-11-24 00:44:03,820 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37375 2836s 2024-11-24 00:44:03,820 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:03,820 - distributed.worker - INFO - dashboard at: 127.0.0.1:43145 2836s 2024-11-24 00:44:03,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39701 2836s 2024-11-24 00:44:03,820 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:03,820 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:03,820 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:03,820 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rl1bbv6l 2836s 2024-11-24 00:44:03,821 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:03,822 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33415. Reason: failure-to-start- 2836s 2024-11-24 00:44:03,822 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:03,823 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37375. Reason: failure-to-start- 2836s 2024-11-24 00:44:03,823 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:03,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39701': TLS handshake failed with remote 'tls://127.0.0.1:54804': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:03,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39701': TLS handshake failed with remote 'tls://127.0.0.1:54820': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:03,825 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:04,830 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:04,834 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39647 2836s 2024-11-24 00:44:04,834 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42949/status 2836s 2024-11-24 00:44:04,834 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:04,842 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43677 2836s 2024-11-24 00:44:04,842 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43677 2836s 2024-11-24 00:44:04,842 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:04,842 - distributed.worker - INFO - dashboard at: 127.0.0.1:38523 2836s 2024-11-24 00:44:04,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39647 2836s 2024-11-24 00:44:04,842 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:04,842 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:04,842 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:04,842 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_cnpxx6e 2836s 2024-11-24 00:44:04,842 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:04,844 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35271 2836s 2024-11-24 00:44:04,844 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35271 2836s 2024-11-24 00:44:04,844 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:04,844 - distributed.worker - INFO - dashboard at: 127.0.0.1:34591 2836s 2024-11-24 00:44:04,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39647 2836s 2024-11-24 00:44:04,844 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:04,844 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:04,844 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:04,844 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lxjk9cf5 2836s 2024-11-24 00:44:04,844 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:04,845 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43677. Reason: failure-to-start- 2836s 2024-11-24 00:44:04,845 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:04,846 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35271. Reason: failure-to-start- 2836s 2024-11-24 00:44:04,846 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:04,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39647': TLS handshake failed with remote 'tls://127.0.0.1:47360': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:04,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39647': TLS handshake failed with remote 'tls://127.0.0.1:47374': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:04,847 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:05,852 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:05,857 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46743 2836s 2024-11-24 00:44:05,857 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35451/status 2836s 2024-11-24 00:44:05,857 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:05,864 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34355 2836s 2024-11-24 00:44:05,864 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34355 2836s 2024-11-24 00:44:05,864 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:05,864 - distributed.worker - INFO - dashboard at: 127.0.0.1:34565 2836s 2024-11-24 00:44:05,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46743 2836s 2024-11-24 00:44:05,865 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:05,865 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:05,865 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:05,865 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x0sg7bpq 2836s 2024-11-24 00:44:05,865 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:05,866 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38899 2836s 2024-11-24 00:44:05,866 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38899 2836s 2024-11-24 00:44:05,866 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:05,866 - distributed.worker - INFO - dashboard at: 127.0.0.1:35555 2836s 2024-11-24 00:44:05,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46743 2836s 2024-11-24 00:44:05,866 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:05,866 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:05,866 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:05,867 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ytd831pr 2836s 2024-11-24 00:44:05,867 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:05,867 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34355. Reason: failure-to-start- 2836s 2024-11-24 00:44:05,867 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:05,868 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38899. Reason: failure-to-start- 2836s 2024-11-24 00:44:05,868 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:05,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46743': TLS handshake failed with remote 'tls://127.0.0.1:42400': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:05,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46743': TLS handshake failed with remote 'tls://127.0.0.1:42410': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:05,869 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:06,875 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:06,878 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44153 2836s 2024-11-24 00:44:06,878 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38151/status 2836s 2024-11-24 00:44:06,878 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:06,887 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42395 2836s 2024-11-24 00:44:06,887 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42395 2836s 2024-11-24 00:44:06,887 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:06,887 - distributed.worker - INFO - dashboard at: 127.0.0.1:43077 2836s 2024-11-24 00:44:06,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 2836s 2024-11-24 00:44:06,887 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:06,887 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:06,887 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:06,887 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xfczxsd9 2836s 2024-11-24 00:44:06,887 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:06,889 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44925 2836s 2024-11-24 00:44:06,889 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44925 2836s 2024-11-24 00:44:06,889 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:06,889 - distributed.worker - INFO - dashboard at: 127.0.0.1:38447 2836s 2024-11-24 00:44:06,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 2836s 2024-11-24 00:44:06,889 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:06,889 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:06,889 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:06,889 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0fnvjws2 2836s 2024-11-24 00:44:06,889 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:06,890 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42395. Reason: failure-to-start- 2836s 2024-11-24 00:44:06,890 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:06,890 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44925. Reason: failure-to-start- 2836s 2024-11-24 00:44:06,890 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:06,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:59488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:06,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:59490': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:06,892 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:07,896 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:07,900 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45777 2836s 2024-11-24 00:44:07,900 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33077/status 2836s 2024-11-24 00:44:07,900 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:07,907 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33491 2836s 2024-11-24 00:44:07,907 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33491 2836s 2024-11-24 00:44:07,907 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:07,907 - distributed.worker - INFO - dashboard at: 127.0.0.1:35597 2836s 2024-11-24 00:44:07,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45777 2836s 2024-11-24 00:44:07,907 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:07,907 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:07,908 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:07,908 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pd0ief6f 2836s 2024-11-24 00:44:07,908 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:07,909 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35917 2836s 2024-11-24 00:44:07,909 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35917 2836s 2024-11-24 00:44:07,909 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:07,909 - distributed.worker - INFO - dashboard at: 127.0.0.1:33161 2836s 2024-11-24 00:44:07,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45777 2836s 2024-11-24 00:44:07,909 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:07,909 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:07,909 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:07,909 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xa7rit7i 2836s 2024-11-24 00:44:07,909 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:07,910 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33491. Reason: failure-to-start- 2836s 2024-11-24 00:44:07,910 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:07,911 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35917. Reason: failure-to-start- 2836s 2024-11-24 00:44:07,911 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:07,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45777': TLS handshake failed with remote 'tls://127.0.0.1:39982': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:07,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45777': TLS handshake failed with remote 'tls://127.0.0.1:39990': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:07,913 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:08,917 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:08,921 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36693 2836s 2024-11-24 00:44:08,921 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39689/status 2836s 2024-11-24 00:44:08,922 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:08,929 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44657 2836s 2024-11-24 00:44:08,929 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44657 2836s 2024-11-24 00:44:08,929 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:08,929 - distributed.worker - INFO - dashboard at: 127.0.0.1:43407 2836s 2024-11-24 00:44:08,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36693 2836s 2024-11-24 00:44:08,929 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:08,929 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:08,930 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:08,930 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fkhimv27 2836s 2024-11-24 00:44:08,930 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:08,931 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35419 2836s 2024-11-24 00:44:08,931 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35419 2836s 2024-11-24 00:44:08,931 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:08,931 - distributed.worker - INFO - dashboard at: 127.0.0.1:40423 2836s 2024-11-24 00:44:08,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36693 2836s 2024-11-24 00:44:08,931 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:08,931 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:08,932 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:08,932 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8tjbh7jm 2836s 2024-11-24 00:44:08,932 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:08,932 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44657. Reason: failure-to-start- 2836s 2024-11-24 00:44:08,933 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:08,933 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35419. Reason: failure-to-start- 2836s 2024-11-24 00:44:08,933 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:08,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36693': TLS handshake failed with remote 'tls://127.0.0.1:58176': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:08,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36693': TLS handshake failed with remote 'tls://127.0.0.1:58188': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:08,935 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:09,940 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:09,944 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37383 2836s 2024-11-24 00:44:09,944 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39241/status 2836s 2024-11-24 00:44:09,944 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:09,952 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35871 2836s 2024-11-24 00:44:09,952 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35871 2836s 2024-11-24 00:44:09,952 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:09,952 - distributed.worker - INFO - dashboard at: 127.0.0.1:43157 2836s 2024-11-24 00:44:09,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37383 2836s 2024-11-24 00:44:09,952 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:09,952 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:09,952 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:09,952 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-55aydnr_ 2836s 2024-11-24 00:44:09,952 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:09,954 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44869 2836s 2024-11-24 00:44:09,954 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44869 2836s 2024-11-24 00:44:09,954 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:09,954 - distributed.worker - INFO - dashboard at: 127.0.0.1:43651 2836s 2024-11-24 00:44:09,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37383 2836s 2024-11-24 00:44:09,954 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:09,954 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:09,954 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:09,954 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1ek2abie 2836s 2024-11-24 00:44:09,954 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:09,955 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35871. Reason: failure-to-start- 2836s 2024-11-24 00:44:09,955 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:09,956 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44869. Reason: failure-to-start- 2836s 2024-11-24 00:44:09,956 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:09,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37383': TLS handshake failed with remote 'tls://127.0.0.1:58548': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:09,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37383': TLS handshake failed with remote 'tls://127.0.0.1:58554': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:09,957 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:10,962 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:10,965 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35833 2836s 2024-11-24 00:44:10,965 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34029/status 2836s 2024-11-24 00:44:10,966 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:10,974 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40651 2836s 2024-11-24 00:44:10,974 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40651 2836s 2024-11-24 00:44:10,975 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:10,975 - distributed.worker - INFO - dashboard at: 127.0.0.1:43379 2836s 2024-11-24 00:44:10,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35833 2836s 2024-11-24 00:44:10,975 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:10,975 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:10,975 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:10,975 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t3pda02f 2836s 2024-11-24 00:44:10,975 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:10,976 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33839 2836s 2024-11-24 00:44:10,976 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33839 2836s 2024-11-24 00:44:10,976 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:10,976 - distributed.worker - INFO - dashboard at: 127.0.0.1:34535 2836s 2024-11-24 00:44:10,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35833 2836s 2024-11-24 00:44:10,977 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:10,977 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:10,977 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:10,977 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qtyco5kf 2836s 2024-11-24 00:44:10,977 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:10,978 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40651. Reason: failure-to-start- 2836s 2024-11-24 00:44:10,978 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:10,978 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33839. Reason: failure-to-start- 2836s 2024-11-24 00:44:10,978 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:10,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35833': TLS handshake failed with remote 'tls://127.0.0.1:56224': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:10,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35833': TLS handshake failed with remote 'tls://127.0.0.1:56234': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:10,980 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:11,985 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:11,989 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37891 2836s 2024-11-24 00:44:11,989 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43195/status 2836s 2024-11-24 00:44:11,990 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:11,998 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42069 2836s 2024-11-24 00:44:11,998 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42069 2836s 2024-11-24 00:44:11,998 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:11,998 - distributed.worker - INFO - dashboard at: 127.0.0.1:34295 2836s 2024-11-24 00:44:11,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37891 2836s 2024-11-24 00:44:11,998 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:11,998 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:11,998 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:11,998 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hljv49ff 2836s 2024-11-24 00:44:11,998 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:12,000 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44893 2836s 2024-11-24 00:44:12,000 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44893 2836s 2024-11-24 00:44:12,000 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:12,000 - distributed.worker - INFO - dashboard at: 127.0.0.1:45347 2836s 2024-11-24 00:44:12,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37891 2836s 2024-11-24 00:44:12,000 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:12,000 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:12,000 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:12,000 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-28go4zcu 2836s 2024-11-24 00:44:12,001 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:12,002 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42069. Reason: failure-to-start- 2836s 2024-11-24 00:44:12,002 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:12,003 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44893. Reason: failure-to-start- 2836s 2024-11-24 00:44:12,003 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:12,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37891': TLS handshake failed with remote 'tls://127.0.0.1:40958': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:12,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37891': TLS handshake failed with remote 'tls://127.0.0.1:40970': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:12,005 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:13,009 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:13,012 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44485 2836s 2024-11-24 00:44:13,013 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33281/status 2836s 2024-11-24 00:44:13,013 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:13,020 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44011 2836s 2024-11-24 00:44:13,020 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44011 2836s 2024-11-24 00:44:13,020 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:13,020 - distributed.worker - INFO - dashboard at: 127.0.0.1:34609 2836s 2024-11-24 00:44:13,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44485 2836s 2024-11-24 00:44:13,020 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:13,020 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:13,020 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:13,020 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-533f81gx 2836s 2024-11-24 00:44:13,021 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:13,022 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39163 2836s 2024-11-24 00:44:13,022 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39163 2836s 2024-11-24 00:44:13,022 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:13,022 - distributed.worker - INFO - dashboard at: 127.0.0.1:37893 2836s 2024-11-24 00:44:13,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44485 2836s 2024-11-24 00:44:13,022 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:13,022 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:13,022 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:13,022 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-64f7_u2b 2836s 2024-11-24 00:44:13,022 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:13,023 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44011. Reason: failure-to-start- 2836s 2024-11-24 00:44:13,023 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:13,024 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39163. Reason: failure-to-start- 2836s 2024-11-24 00:44:13,024 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:13,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44485': TLS handshake failed with remote 'tls://127.0.0.1:41746': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:13,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44485': TLS handshake failed with remote 'tls://127.0.0.1:41754': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:13,025 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:14,030 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:14,044 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35095 2836s 2024-11-24 00:44:14,045 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33559/status 2836s 2024-11-24 00:44:14,045 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:14,053 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39605 2836s 2024-11-24 00:44:14,053 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39605 2836s 2024-11-24 00:44:14,053 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:14,053 - distributed.worker - INFO - dashboard at: 127.0.0.1:37827 2836s 2024-11-24 00:44:14,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35095 2836s 2024-11-24 00:44:14,053 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:14,053 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:14,053 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:14,053 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4f6igmjd 2836s 2024-11-24 00:44:14,053 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:14,055 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36471 2836s 2024-11-24 00:44:14,055 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36471 2836s 2024-11-24 00:44:14,055 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:14,055 - distributed.worker - INFO - dashboard at: 127.0.0.1:43073 2836s 2024-11-24 00:44:14,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35095 2836s 2024-11-24 00:44:14,055 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:14,055 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:14,055 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:14,055 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z0c8py16 2836s 2024-11-24 00:44:14,055 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:14,056 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39605. Reason: failure-to-start- 2836s 2024-11-24 00:44:14,056 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:14,056 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36471. Reason: failure-to-start- 2836s 2024-11-24 00:44:14,056 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:14,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35095': TLS handshake failed with remote 'tls://127.0.0.1:53154': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:14,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35095': TLS handshake failed with remote 'tls://127.0.0.1:53160': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:14,058 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:15,064 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:15,068 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33037 2836s 2024-11-24 00:44:15,068 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33891/status 2836s 2024-11-24 00:44:15,068 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:15,078 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34317 2836s 2024-11-24 00:44:15,078 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34317 2836s 2024-11-24 00:44:15,078 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:15,078 - distributed.worker - INFO - dashboard at: 127.0.0.1:34297 2836s 2024-11-24 00:44:15,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33037 2836s 2024-11-24 00:44:15,078 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:15,078 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:15,078 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:15,079 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7dhpatxw 2836s 2024-11-24 00:44:15,079 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:15,080 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46507 2836s 2024-11-24 00:44:15,080 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46507 2836s 2024-11-24 00:44:15,080 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:15,080 - distributed.worker - INFO - dashboard at: 127.0.0.1:41721 2836s 2024-11-24 00:44:15,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33037 2836s 2024-11-24 00:44:15,080 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:15,081 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:15,081 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:15,081 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tcdrft8s 2836s 2024-11-24 00:44:15,081 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:15,082 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34317. Reason: failure-to-start- 2836s 2024-11-24 00:44:15,082 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:15,082 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46507. Reason: failure-to-start- 2836s 2024-11-24 00:44:15,082 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:15,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33037': TLS handshake failed with remote 'tls://127.0.0.1:60266': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:15,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33037': TLS handshake failed with remote 'tls://127.0.0.1:60268': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:15,084 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:16,089 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:16,092 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42429 2836s 2024-11-24 00:44:16,093 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44467/status 2836s 2024-11-24 00:44:16,093 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:16,100 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33761 2836s 2024-11-24 00:44:16,100 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33761 2836s 2024-11-24 00:44:16,101 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:16,101 - distributed.worker - INFO - dashboard at: 127.0.0.1:36863 2836s 2024-11-24 00:44:16,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42429 2836s 2024-11-24 00:44:16,101 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:16,101 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:16,101 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:16,101 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xwtqb4b_ 2836s 2024-11-24 00:44:16,101 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:16,102 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39823 2836s 2024-11-24 00:44:16,102 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39823 2836s 2024-11-24 00:44:16,102 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:16,103 - distributed.worker - INFO - dashboard at: 127.0.0.1:45313 2836s 2024-11-24 00:44:16,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42429 2836s 2024-11-24 00:44:16,103 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:16,103 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:16,103 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:16,103 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h2vtirfq 2836s 2024-11-24 00:44:16,103 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:16,105 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33761. Reason: failure-to-start- 2836s 2024-11-24 00:44:16,105 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:16,105 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39823. Reason: failure-to-start- 2836s 2024-11-24 00:44:16,105 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:16,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42429': TLS handshake failed with remote 'tls://127.0.0.1:48784': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:16,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42429': TLS handshake failed with remote 'tls://127.0.0.1:48786': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:16,107 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:17,113 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:17,117 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42107 2836s 2024-11-24 00:44:17,117 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36435/status 2836s 2024-11-24 00:44:17,117 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:17,125 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34263 2836s 2024-11-24 00:44:17,125 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34263 2836s 2024-11-24 00:44:17,125 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:17,125 - distributed.worker - INFO - dashboard at: 127.0.0.1:46761 2836s 2024-11-24 00:44:17,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42107 2836s 2024-11-24 00:44:17,125 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:17,125 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:17,126 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:17,126 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u4g37hfh 2836s 2024-11-24 00:44:17,126 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:17,127 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33393 2836s 2024-11-24 00:44:17,127 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33393 2836s 2024-11-24 00:44:17,127 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:17,127 - distributed.worker - INFO - dashboard at: 127.0.0.1:39261 2836s 2024-11-24 00:44:17,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42107 2836s 2024-11-24 00:44:17,128 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:17,128 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:17,128 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:17,128 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zkizy6u2 2836s 2024-11-24 00:44:17,128 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:17,129 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34263. Reason: failure-to-start- 2836s 2024-11-24 00:44:17,129 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:17,129 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33393. Reason: failure-to-start- 2836s 2024-11-24 00:44:17,129 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:17,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42107': TLS handshake failed with remote 'tls://127.0.0.1:55752': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:17,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42107': TLS handshake failed with remote 'tls://127.0.0.1:55760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:17,132 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:18,137 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:18,142 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40627 2836s 2024-11-24 00:44:18,142 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33405/status 2836s 2024-11-24 00:44:18,142 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:18,150 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35369 2836s 2024-11-24 00:44:18,150 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35369 2836s 2024-11-24 00:44:18,150 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:18,150 - distributed.worker - INFO - dashboard at: 127.0.0.1:39743 2836s 2024-11-24 00:44:18,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40627 2836s 2024-11-24 00:44:18,150 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:18,150 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:18,150 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:18,150 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vuj17fcs 2836s 2024-11-24 00:44:18,150 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:18,152 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35353 2836s 2024-11-24 00:44:18,152 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35353 2836s 2024-11-24 00:44:18,152 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:18,152 - distributed.worker - INFO - dashboard at: 127.0.0.1:40467 2836s 2024-11-24 00:44:18,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40627 2836s 2024-11-24 00:44:18,152 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:18,152 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:18,152 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:18,152 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h72bo66z 2836s 2024-11-24 00:44:18,152 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:18,153 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35369. Reason: failure-to-start- 2836s 2024-11-24 00:44:18,153 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:18,154 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35353. Reason: failure-to-start- 2836s 2024-11-24 00:44:18,154 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:18,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40627': TLS handshake failed with remote 'tls://127.0.0.1:60136': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:18,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40627': TLS handshake failed with remote 'tls://127.0.0.1:60152': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:18,157 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:19,161 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:19,165 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36527 2836s 2024-11-24 00:44:19,165 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33593/status 2836s 2024-11-24 00:44:19,165 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:19,174 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37195 2836s 2024-11-24 00:44:19,174 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37195 2836s 2024-11-24 00:44:19,175 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:19,175 - distributed.worker - INFO - dashboard at: 127.0.0.1:33257 2836s 2024-11-24 00:44:19,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36527 2836s 2024-11-24 00:44:19,175 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:19,175 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:19,175 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:19,175 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7qb06r8c 2836s 2024-11-24 00:44:19,175 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:19,176 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38885 2836s 2024-11-24 00:44:19,177 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38885 2836s 2024-11-24 00:44:19,177 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:19,177 - distributed.worker - INFO - dashboard at: 127.0.0.1:36781 2836s 2024-11-24 00:44:19,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36527 2836s 2024-11-24 00:44:19,177 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:19,177 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:19,177 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:19,177 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6toso4cw 2836s 2024-11-24 00:44:19,177 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:19,179 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37195. Reason: failure-to-start- 2836s 2024-11-24 00:44:19,179 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:19,179 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38885. Reason: failure-to-start- 2836s 2024-11-24 00:44:19,179 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:19,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36527': TLS handshake failed with remote 'tls://127.0.0.1:36932': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:19,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36527': TLS handshake failed with remote 'tls://127.0.0.1:36936': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:19,181 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:20,186 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:20,189 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33271 2836s 2024-11-24 00:44:20,190 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40025/status 2836s 2024-11-24 00:44:20,190 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:20,198 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38341 2836s 2024-11-24 00:44:20,198 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38341 2836s 2024-11-24 00:44:20,198 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:20,198 - distributed.worker - INFO - dashboard at: 127.0.0.1:39319 2836s 2024-11-24 00:44:20,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33271 2836s 2024-11-24 00:44:20,198 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:20,198 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:20,198 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:20,199 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-22jyweld 2836s 2024-11-24 00:44:20,199 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:20,201 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40313 2836s 2024-11-24 00:44:20,201 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40313 2836s 2024-11-24 00:44:20,201 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:20,201 - distributed.worker - INFO - dashboard at: 127.0.0.1:46471 2836s 2024-11-24 00:44:20,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33271 2836s 2024-11-24 00:44:20,202 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:20,202 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:20,202 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:20,202 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gsd7ae40 2836s 2024-11-24 00:44:20,202 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:20,204 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38341. Reason: failure-to-start- 2836s 2024-11-24 00:44:20,204 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:20,204 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40313. Reason: failure-to-start- 2836s 2024-11-24 00:44:20,204 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:20,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33271': TLS handshake failed with remote 'tls://127.0.0.1:49346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:20,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33271': TLS handshake failed with remote 'tls://127.0.0.1:49356': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:20,206 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:21,210 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:21,214 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42279 2836s 2024-11-24 00:44:21,214 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45945/status 2836s 2024-11-24 00:44:21,214 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:21,223 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34495 2836s 2024-11-24 00:44:21,223 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34495 2836s 2024-11-24 00:44:21,223 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:21,223 - distributed.worker - INFO - dashboard at: 127.0.0.1:35721 2836s 2024-11-24 00:44:21,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42279 2836s 2024-11-24 00:44:21,223 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:21,223 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:21,223 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:21,223 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u3nj89nc 2836s 2024-11-24 00:44:21,223 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:21,225 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35217 2836s 2024-11-24 00:44:21,225 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35217 2836s 2024-11-24 00:44:21,225 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:21,225 - distributed.worker - INFO - dashboard at: 127.0.0.1:45355 2836s 2024-11-24 00:44:21,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42279 2836s 2024-11-24 00:44:21,225 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:21,225 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:21,225 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:21,225 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9fg5co3o 2836s 2024-11-24 00:44:21,225 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:21,227 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34495. Reason: failure-to-start- 2836s 2024-11-24 00:44:21,227 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:21,228 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35217. Reason: failure-to-start- 2836s 2024-11-24 00:44:21,228 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:21,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42279': TLS handshake failed with remote 'tls://127.0.0.1:44298': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:21,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42279': TLS handshake failed with remote 'tls://127.0.0.1:44302': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:21,230 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:22,236 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:22,240 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38729 2836s 2024-11-24 00:44:22,240 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36491/status 2836s 2024-11-24 00:44:22,240 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:22,249 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36653 2836s 2024-11-24 00:44:22,249 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36653 2836s 2024-11-24 00:44:22,249 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:22,249 - distributed.worker - INFO - dashboard at: 127.0.0.1:34747 2836s 2024-11-24 00:44:22,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38729 2836s 2024-11-24 00:44:22,249 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:22,249 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:22,249 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:22,249 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1_wf9hho 2836s 2024-11-24 00:44:22,250 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:22,251 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42709 2836s 2024-11-24 00:44:22,251 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42709 2836s 2024-11-24 00:44:22,251 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:22,251 - distributed.worker - INFO - dashboard at: 127.0.0.1:44977 2836s 2024-11-24 00:44:22,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38729 2836s 2024-11-24 00:44:22,251 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:22,251 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:22,251 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:22,251 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dod7n8xs 2836s 2024-11-24 00:44:22,251 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:22,252 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36653. Reason: failure-to-start- 2836s 2024-11-24 00:44:22,252 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:22,253 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42709. Reason: failure-to-start- 2836s 2024-11-24 00:44:22,253 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:22,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38729': TLS handshake failed with remote 'tls://127.0.0.1:60870': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:22,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38729': TLS handshake failed with remote 'tls://127.0.0.1:60882': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:22,255 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:23,259 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:23,263 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43201 2836s 2024-11-24 00:44:23,263 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46817/status 2836s 2024-11-24 00:44:23,264 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:23,274 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45915 2836s 2024-11-24 00:44:23,274 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45915 2836s 2024-11-24 00:44:23,274 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:23,274 - distributed.worker - INFO - dashboard at: 127.0.0.1:36067 2836s 2024-11-24 00:44:23,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43201 2836s 2024-11-24 00:44:23,274 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:23,274 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:23,274 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:23,274 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7tw3tvsk 2836s 2024-11-24 00:44:23,275 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:23,276 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34459 2836s 2024-11-24 00:44:23,276 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34459 2836s 2024-11-24 00:44:23,276 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:23,276 - distributed.worker - INFO - dashboard at: 127.0.0.1:43409 2836s 2024-11-24 00:44:23,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43201 2836s 2024-11-24 00:44:23,276 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:23,276 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:23,276 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:23,276 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tmptud3w 2836s 2024-11-24 00:44:23,277 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:23,277 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45915. Reason: failure-to-start- 2836s 2024-11-24 00:44:23,277 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:23,278 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34459. Reason: failure-to-start- 2836s 2024-11-24 00:44:23,278 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:23,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43201': TLS handshake failed with remote 'tls://127.0.0.1:54330': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:23,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43201': TLS handshake failed with remote 'tls://127.0.0.1:54332': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:23,280 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:24,284 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:24,288 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38583 2836s 2024-11-24 00:44:24,288 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39021/status 2836s 2024-11-24 00:44:24,289 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:24,297 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38387 2836s 2024-11-24 00:44:24,298 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38387 2836s 2024-11-24 00:44:24,298 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:24,298 - distributed.worker - INFO - dashboard at: 127.0.0.1:36233 2836s 2024-11-24 00:44:24,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38583 2836s 2024-11-24 00:44:24,298 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:24,298 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:24,298 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:24,298 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mgns902r 2836s 2024-11-24 00:44:24,298 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:24,301 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45073 2836s 2024-11-24 00:44:24,301 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45073 2836s 2024-11-24 00:44:24,301 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:24,301 - distributed.worker - INFO - dashboard at: 127.0.0.1:33447 2836s 2024-11-24 00:44:24,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38583 2836s 2024-11-24 00:44:24,301 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:24,301 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:24,301 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:24,301 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g2xs1nvx 2836s 2024-11-24 00:44:24,301 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:24,302 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38387. Reason: failure-to-start- 2836s 2024-11-24 00:44:24,302 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:24,303 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45073. Reason: failure-to-start- 2836s 2024-11-24 00:44:24,303 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:24,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38583': TLS handshake failed with remote 'tls://127.0.0.1:53062': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:24,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38583': TLS handshake failed with remote 'tls://127.0.0.1:53072': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:24,304 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:25,309 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:25,313 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44837 2836s 2024-11-24 00:44:25,313 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33859/status 2836s 2024-11-24 00:44:25,314 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:25,322 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42957 2836s 2024-11-24 00:44:25,322 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42957 2836s 2024-11-24 00:44:25,322 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:25,322 - distributed.worker - INFO - dashboard at: 127.0.0.1:38345 2836s 2024-11-24 00:44:25,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44837 2836s 2024-11-24 00:44:25,322 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:25,322 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:25,322 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:25,322 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ef612miy 2836s 2024-11-24 00:44:25,323 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:25,324 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35757 2836s 2024-11-24 00:44:25,324 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35757 2836s 2024-11-24 00:44:25,324 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:25,324 - distributed.worker - INFO - dashboard at: 127.0.0.1:42853 2836s 2024-11-24 00:44:25,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44837 2836s 2024-11-24 00:44:25,324 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:25,324 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:25,324 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:25,324 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ukgxn1h4 2836s 2024-11-24 00:44:25,324 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:25,325 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42957. Reason: failure-to-start- 2836s 2024-11-24 00:44:25,325 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:25,326 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35757. Reason: failure-to-start- 2836s 2024-11-24 00:44:25,326 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:25,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44837': TLS handshake failed with remote 'tls://127.0.0.1:54132': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:25,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44837': TLS handshake failed with remote 'tls://127.0.0.1:54146': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:25,328 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2836s af, addr, stream = await connector.start(connect_timeout=timeout) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s asyncio.exceptions.CancelledError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2836s await wait_for(self.start_unsafe(), timeout=timeout) 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2836s async with asyncio.timeout(timeout): 2836s ~~~~~~~~~~~~~~~^^^^^^^^^ 2836s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2836s raise TimeoutError from exc_val 2836s TimeoutError 2836s 2836s The above exception was the direct cause of the following exception: 2836s 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2836s s, ws = await start_cluster( 2836s ^^^^^^^^^^^^^^^^^^^^ 2836s ...<9 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2836s await asyncio.gather(*workers) 2836s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2836s return await awaitable 2836s ^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2836s raise asyncio.TimeoutError( 2836s f"{type(self).__name__} start timed out after {timeout}s." 2836s ) from exc 2836s TimeoutError: Worker start timed out after 0s. 2836s 2024-11-24 00:44:26,333 - distributed.scheduler - INFO - State start 2836s 2024-11-24 00:44:26,337 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33355 2836s 2024-11-24 00:44:26,337 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40803/status 2836s 2024-11-24 00:44:26,338 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2836s 2024-11-24 00:44:26,347 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45909 2836s 2024-11-24 00:44:26,347 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45909 2836s 2024-11-24 00:44:26,347 - distributed.worker - INFO - Worker name: 0 2836s 2024-11-24 00:44:26,347 - distributed.worker - INFO - dashboard at: 127.0.0.1:40209 2836s 2024-11-24 00:44:26,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33355 2836s 2024-11-24 00:44:26,347 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:26,348 - distributed.worker - INFO - Threads: 1 2836s 2024-11-24 00:44:26,348 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:26,348 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cb6vbww7 2836s 2024-11-24 00:44:26,348 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:26,349 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45169 2836s 2024-11-24 00:44:26,350 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45169 2836s 2024-11-24 00:44:26,350 - distributed.worker - INFO - Worker name: 1 2836s 2024-11-24 00:44:26,350 - distributed.worker - INFO - dashboard at: 127.0.0.1:41095 2836s 2024-11-24 00:44:26,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33355 2836s 2024-11-24 00:44:26,350 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:26,350 - distributed.worker - INFO - Threads: 2 2836s 2024-11-24 00:44:26,350 - distributed.worker - INFO - Memory: 7.73 GiB 2836s 2024-11-24 00:44:26,350 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bdsdkj8q 2836s 2024-11-24 00:44:26,350 - distributed.worker - INFO - ------------------------------------------------- 2836s 2024-11-24 00:44:26,351 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45909. Reason: failure-to-start- 2836s 2024-11-24 00:44:26,351 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:26,351 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45169. Reason: failure-to-start- 2836s 2024-11-24 00:44:26,352 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2836s 2024-11-24 00:44:26,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33355': TLS handshake failed with remote 'tls://127.0.0.1:60590': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:26,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33355': TLS handshake failed with remote 'tls://127.0.0.1:60606': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2836s 2024-11-24 00:44:26,354 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2836s Traceback (most recent call last): 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2836s await self._register_with_scheduler() 2836s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2836s comm = await connect(self.scheduler.address, **self.connection_args) 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2836s comm = await wait_for( 2836s ^^^^^^^^^^^^^^^ 2836s ...<2 lines>... 2836s ) 2836s ^ 2836s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2836s return await fut 2836s ^^^^^^^^^ 2836s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2836s stream = await self.client.connect( 2836s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:44:27,359 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:44:27,362 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41585 2837s 2024-11-24 00:44:27,363 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41469/status 2837s 2024-11-24 00:44:27,363 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:44:27,373 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36239 2837s 2024-11-24 00:44:27,374 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36239 2837s 2024-11-24 00:44:27,374 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:44:27,374 - distributed.worker - INFO - dashboard at: 127.0.0.1:43291 2837s 2024-11-24 00:44:27,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41585 2837s 2024-11-24 00:44:27,374 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:27,374 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:44:27,374 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:44:27,374 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-irfl18zd 2837s 2024-11-24 00:44:27,374 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:27,376 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40783 2837s 2024-11-24 00:44:27,376 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40783 2837s 2024-11-24 00:44:27,376 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:44:27,376 - distributed.worker - INFO - dashboard at: 127.0.0.1:38179 2837s 2024-11-24 00:44:27,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41585 2837s 2024-11-24 00:44:27,376 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:27,376 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:44:27,376 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:44:27,376 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nsclt714 2837s 2024-11-24 00:44:27,376 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:27,377 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36239. Reason: failure-to-start- 2837s 2024-11-24 00:44:27,377 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:44:27,378 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40783. Reason: failure-to-start- 2837s 2024-11-24 00:44:27,378 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:44:27,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41585': TLS handshake failed with remote 'tls://127.0.0.1:51978': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:44:27,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41585': TLS handshake failed with remote 'tls://127.0.0.1:51988': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:44:27,381 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s __________________________________ test_Queue __________________________________ 2837s 2837s fut = , timeout = 0 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 2837s await self._register_with_scheduler() 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2837s comm = await wait_for( 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2837s return await fut 2837s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 2837s stream = await self.client.connect( 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s host = '127.0.0.1', port = 37367, af = 2837s ssl_options = 2837s max_buffer_size = 4151066624.0, source_ip = None, source_port = None 2837s timeout = None 2837s 2837s async def connect( 2837s self, 2837s host: str, 2837s port: int, 2837s af: socket.AddressFamily = socket.AF_UNSPEC, 2837s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 2837s max_buffer_size: Optional[int] = None, 2837s source_ip: Optional[str] = None, 2837s source_port: Optional[int] = None, 2837s timeout: Optional[Union[float, datetime.timedelta]] = None, 2837s ) -> IOStream: 2837s """Connect to the given host and port. 2837s 2837s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 2837s ``ssl_options`` is not None). 2837s 2837s Using the ``source_ip`` kwarg, one can specify the source 2837s IP address to use when establishing the connection. 2837s In case the user needs to resolve and 2837s use a specific interface, it has to be handled outside 2837s of Tornado as this depends very much on the platform. 2837s 2837s Raises `TimeoutError` if the input future does not complete before 2837s ``timeout``, which may be specified in any form allowed by 2837s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 2837s relative to `.IOLoop.time`) 2837s 2837s Similarly, when the user requires a certain source port, it can 2837s be specified using the ``source_port`` arg. 2837s 2837s .. versionchanged:: 4.5 2837s Added the ``source_ip`` and ``source_port`` arguments. 2837s 2837s .. versionchanged:: 5.0 2837s Added the ``timeout`` argument. 2837s """ 2837s if timeout is not None: 2837s if isinstance(timeout, numbers.Real): 2837s timeout = IOLoop.current().time() + timeout 2837s elif isinstance(timeout, datetime.timedelta): 2837s timeout = IOLoop.current().time() + timeout.total_seconds() 2837s else: 2837s raise TypeError("Unsupported timeout %r" % timeout) 2837s if timeout is not None: 2837s addrinfo = await gen.with_timeout( 2837s timeout, self.resolver.resolve(host, port, af) 2837s ) 2837s else: 2837s addrinfo = await self.resolver.resolve(host, port, af) 2837s connector = _Connector( 2837s addrinfo, 2837s functools.partial( 2837s self._create_stream, 2837s max_buffer_size, 2837s source_ip=source_ip, 2837s source_port=source_port, 2837s ), 2837s ) 2837s > af, addr, stream = await connector.start(connect_timeout=timeout) 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s > await wait_for(self.start_unsafe(), timeout=timeout) 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:664: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s @contextlib.asynccontextmanager 2837s async def _cluster_factory(): 2837s workers = [] 2837s s = None 2837s try: 2837s for _ in range(60): 2837s try: 2837s > s, ws = await start_cluster( 2837s nthreads, 2837s scheduler, 2837s security=security, 2837s Worker=Worker, 2837s scheduler_kwargs=scheduler_kwargs, 2837s worker_kwargs=merge( 2837s {"death_timeout": min(15, int(deadline.remaining))}, 2837s worker_kwargs, 2837s ), 2837s ) 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 2837s await asyncio.gather(*workers) 2837s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 2837s return await awaitable 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s except asyncio.TimeoutError as exc: 2837s await _close_on_failure(exc) 2837s > raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s E TimeoutError: Worker start timed out after 0s. 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s fut = ._..test_func..async_fn at 0xe63f7717a2b0> 2837s timeout = 60 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 2837s _cluster_factory() as (s, workers), 2837s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 2837s return await anext(self.gen) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 2837s await asyncio.sleep(1) 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s delay = 1, result = None 2837s 2837s async def sleep(delay, result=None): 2837s """Coroutine that completes after a given time (in seconds).""" 2837s if delay <= 0: 2837s await __sleep0() 2837s return result 2837s 2837s if math.isnan(delay): 2837s raise ValueError("Invalid delay: NaN (not a number)") 2837s 2837s loop = events.get_running_loop() 2837s future = loop.create_future() 2837s h = loop.call_later(delay, 2837s futures._set_result_unless_cancelled, 2837s future, result) 2837s try: 2837s > return await future 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s args = (), kwds = {} 2837s 2837s @wraps(func) 2837s def inner(*args, **kwds): 2837s with self._recreate_cm(): 2837s > return func(*args, **kwds) 2837s 2837s /usr/lib/python3.13/contextlib.py:85: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3.13/contextlib.py:85: in inner 2837s return func(*args, **kwds) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 2837s return _run_and_close_tornado(async_fn_outer) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 2837s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 2837s /usr/lib/python3.13/asyncio/runners.py:194: in run 2837s return runner.run(main) 2837s /usr/lib/python3.13/asyncio/runners.py:118: in run 2837s return self._loop.run_until_complete(task) 2837s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 2837s return future.result() 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 2837s return await async_fn(*args, **kwargs) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 2837s return await utils_wait_for(async_fn(), timeout=timeout * 2) 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s ----------------------------- Captured stderr call ----------------------------- 2837s 2024-11-24 00:44:28,095 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:44:28,099 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,099 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40947/status 2837s 2024-11-24 00:44:28,100 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:44:28,107 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40617 2837s 2024-11-24 00:44:28,107 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40617 2837s 2024-11-24 00:44:28,107 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:44:28,107 - distributed.worker - INFO - dashboard at: 127.0.0.1:36823 2837s 2024-11-24 00:44:28,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,108 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:28,108 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:44:28,108 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:44:28,108 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e6z1dsle 2837s 2024-11-24 00:44:28,108 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:28,109 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42181 2837s 2024-11-24 00:44:28,109 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42181 2837s 2024-11-24 00:44:28,109 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:44:28,109 - distributed.worker - INFO - dashboard at: 127.0.0.1:37605 2837s 2024-11-24 00:44:28,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,109 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:28,109 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:44:28,110 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:44:28,110 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g44mnue3 2837s 2024-11-24 00:44:28,110 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:28,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:28,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:28,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:28,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:28,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:28,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:28,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:28,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:28,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:28,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:28,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:28,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:28,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:28,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:28,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:28,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:28,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:29,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:29,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:30,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:30,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:57998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:31,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:31,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:32,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:32,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:33,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:33,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:34,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:34,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:58720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:49878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:49894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:49908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:49912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:49928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:49944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:49958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:49972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:49986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:49990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:49994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:35,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:35,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:36,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:36,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:37,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:37,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:38,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:38,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:39,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:39,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:40,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:40,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:50994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:41,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:41,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:42,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:42,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:43,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:43,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:43,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 2837s 2024-11-24 00:44:43,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:51298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:43,107 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40617. Reason: failure-to-start- 2837s 2024-11-24 00:44:43,107 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:44:43,108 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 15s. 2837s 2024-11-24 00:44:43,111 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42181. Reason: failure-to-start- 2837s 2024-11-24 00:44:43,111 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:44:44,114 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:44:44,118 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,118 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42331/status 2837s 2024-11-24 00:44:44,119 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:44:44,126 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46861 2837s 2024-11-24 00:44:44,126 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46861 2837s 2024-11-24 00:44:44,126 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:44:44,126 - distributed.worker - INFO - dashboard at: 127.0.0.1:36099 2837s 2024-11-24 00:44:44,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,126 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:44,126 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:44:44,127 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:44:44,127 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cn4lfc72 2837s 2024-11-24 00:44:44,127 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:44,128 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36047 2837s 2024-11-24 00:44:44,128 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36047 2837s 2024-11-24 00:44:44,128 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:44:44,128 - distributed.worker - INFO - dashboard at: 127.0.0.1:36077 2837s 2024-11-24 00:44:44,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,128 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:44,128 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:44:44,128 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:44:44,128 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wc4f1rhl 2837s 2024-11-24 00:44:44,129 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:44,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:44,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:44,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:44,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:44,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:44,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:44,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:44,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:44,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:44,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:44,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:44,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:44,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:44,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:44,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:44,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:44,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:44,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:40972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:45,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:45,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:46,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:46,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:47,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:47,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:48,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:48,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:49,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:49,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:48994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:50,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:50,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:51,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:51,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:52,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:52,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:53,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:53,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:54,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:54,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:49760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:55,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:55,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:56,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:56,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:57,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:57,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:57,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41833 2837s 2024-11-24 00:44:57,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41833': TLS handshake failed with remote 'tls://127.0.0.1:55956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:44:57,126 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46861. Reason: failure-to-start- 2837s 2024-11-24 00:44:57,126 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:44:57,127 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 13s. 2837s 2024-11-24 00:44:57,130 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36047. Reason: failure-to-start- 2837s 2024-11-24 00:44:57,130 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:44:58,132 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:44:58,136 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40047 2837s 2024-11-24 00:44:58,136 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44623/status 2837s 2024-11-24 00:44:58,136 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:44:58,144 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44345 2837s 2024-11-24 00:44:58,145 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44345 2837s 2024-11-24 00:44:58,145 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:44:58,145 - distributed.worker - INFO - dashboard at: 127.0.0.1:42067 2837s 2024-11-24 00:44:58,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40047 2837s 2024-11-24 00:44:58,145 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:58,145 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:44:58,145 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:44:58,145 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8ruk8zig 2837s 2024-11-24 00:44:58,145 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:58,147 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45371 2837s 2024-11-24 00:44:58,147 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45371 2837s 2024-11-24 00:44:58,147 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:44:58,147 - distributed.worker - INFO - dashboard at: 127.0.0.1:41321 2837s 2024-11-24 00:44:58,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40047 2837s 2024-11-24 00:44:58,147 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:58,147 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:44:58,147 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:44:58,147 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c1onxeuu 2837s 2024-11-24 00:44:58,147 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:58,148 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44345. Reason: failure-to-start- 2837s 2024-11-24 00:44:58,148 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:44:58,148 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45371. Reason: failure-to-start- 2837s 2024-11-24 00:44:58,148 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:44:58,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40047': TLS handshake failed with remote 'tls://127.0.0.1:51150': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:44:58,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40047': TLS handshake failed with remote 'tls://127.0.0.1:51152': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:44:58,150 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:44:59,155 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:44:59,158 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38223 2837s 2024-11-24 00:44:59,158 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37519/status 2837s 2024-11-24 00:44:59,159 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:44:59,166 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37481 2837s 2024-11-24 00:44:59,166 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37481 2837s 2024-11-24 00:44:59,166 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:44:59,167 - distributed.worker - INFO - dashboard at: 127.0.0.1:33395 2837s 2024-11-24 00:44:59,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38223 2837s 2024-11-24 00:44:59,167 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:59,167 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:44:59,167 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:44:59,167 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hdd__ywj 2837s 2024-11-24 00:44:59,167 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:59,168 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45923 2837s 2024-11-24 00:44:59,168 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45923 2837s 2024-11-24 00:44:59,168 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:44:59,169 - distributed.worker - INFO - dashboard at: 127.0.0.1:42581 2837s 2024-11-24 00:44:59,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38223 2837s 2024-11-24 00:44:59,169 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:59,169 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:44:59,169 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:44:59,169 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5l2fzwn6 2837s 2024-11-24 00:44:59,169 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:44:59,170 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37481. Reason: failure-to-start- 2837s 2024-11-24 00:44:59,170 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:44:59,170 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45923. Reason: failure-to-start- 2837s 2024-11-24 00:44:59,170 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:44:59,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38223': TLS handshake failed with remote 'tls://127.0.0.1:50652': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:44:59,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38223': TLS handshake failed with remote 'tls://127.0.0.1:50664': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:44:59,172 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:00,177 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:00,181 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42969 2837s 2024-11-24 00:45:00,182 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40823/status 2837s 2024-11-24 00:45:00,182 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:00,189 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36803 2837s 2024-11-24 00:45:00,189 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36803 2837s 2024-11-24 00:45:00,189 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:00,190 - distributed.worker - INFO - dashboard at: 127.0.0.1:33669 2837s 2024-11-24 00:45:00,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42969 2837s 2024-11-24 00:45:00,190 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:00,190 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:00,190 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:00,190 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tibeud6b 2837s 2024-11-24 00:45:00,190 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:00,191 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34295 2837s 2024-11-24 00:45:00,191 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34295 2837s 2024-11-24 00:45:00,191 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:00,191 - distributed.worker - INFO - dashboard at: 127.0.0.1:41251 2837s 2024-11-24 00:45:00,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42969 2837s 2024-11-24 00:45:00,191 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:00,192 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:00,192 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:00,192 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-itbu81c4 2837s 2024-11-24 00:45:00,192 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:00,192 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36803. Reason: failure-to-start- 2837s 2024-11-24 00:45:00,192 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:00,193 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34295. Reason: failure-to-start- 2837s 2024-11-24 00:45:00,193 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:00,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42969': TLS handshake failed with remote 'tls://127.0.0.1:47178': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:00,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42969': TLS handshake failed with remote 'tls://127.0.0.1:47194': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:00,195 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:01,199 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:01,203 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36717 2837s 2024-11-24 00:45:01,203 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42873/status 2837s 2024-11-24 00:45:01,204 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:01,213 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42577 2837s 2024-11-24 00:45:01,213 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42577 2837s 2024-11-24 00:45:01,213 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:01,213 - distributed.worker - INFO - dashboard at: 127.0.0.1:37411 2837s 2024-11-24 00:45:01,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36717 2837s 2024-11-24 00:45:01,213 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:01,213 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:01,213 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:01,213 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cx6863nl 2837s 2024-11-24 00:45:01,213 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:01,215 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35557 2837s 2024-11-24 00:45:01,215 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35557 2837s 2024-11-24 00:45:01,215 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:01,215 - distributed.worker - INFO - dashboard at: 127.0.0.1:40169 2837s 2024-11-24 00:45:01,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36717 2837s 2024-11-24 00:45:01,215 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:01,215 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:01,215 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:01,215 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lqrg_i7d 2837s 2024-11-24 00:45:01,216 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:01,216 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42577. Reason: failure-to-start- 2837s 2024-11-24 00:45:01,216 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:01,217 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35557. Reason: failure-to-start- 2837s 2024-11-24 00:45:01,217 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:01,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36717': TLS handshake failed with remote 'tls://127.0.0.1:49492': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:01,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36717': TLS handshake failed with remote 'tls://127.0.0.1:49504': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:01,219 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:02,223 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:02,227 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34493 2837s 2024-11-24 00:45:02,227 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45201/status 2837s 2024-11-24 00:45:02,227 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:02,235 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43637 2837s 2024-11-24 00:45:02,235 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43637 2837s 2024-11-24 00:45:02,235 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:02,235 - distributed.worker - INFO - dashboard at: 127.0.0.1:46783 2837s 2024-11-24 00:45:02,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34493 2837s 2024-11-24 00:45:02,235 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:02,235 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:02,235 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:02,235 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pm4epav7 2837s 2024-11-24 00:45:02,235 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:02,237 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42115 2837s 2024-11-24 00:45:02,237 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42115 2837s 2024-11-24 00:45:02,238 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:02,238 - distributed.worker - INFO - dashboard at: 127.0.0.1:38375 2837s 2024-11-24 00:45:02,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34493 2837s 2024-11-24 00:45:02,238 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:02,238 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:02,238 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:02,238 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hlpdnmku 2837s 2024-11-24 00:45:02,238 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:02,239 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43637. Reason: failure-to-start- 2837s 2024-11-24 00:45:02,239 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:02,239 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42115. Reason: failure-to-start- 2837s 2024-11-24 00:45:02,239 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:02,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34493': TLS handshake failed with remote 'tls://127.0.0.1:53042': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:02,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34493': TLS handshake failed with remote 'tls://127.0.0.1:53056': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:02,241 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:03,245 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:03,249 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46315 2837s 2024-11-24 00:45:03,249 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37565/status 2837s 2024-11-24 00:45:03,249 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:03,257 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43729 2837s 2024-11-24 00:45:03,257 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43729 2837s 2024-11-24 00:45:03,257 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:03,257 - distributed.worker - INFO - dashboard at: 127.0.0.1:39571 2837s 2024-11-24 00:45:03,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46315 2837s 2024-11-24 00:45:03,257 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:03,257 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:03,257 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:03,257 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ezsktdwy 2837s 2024-11-24 00:45:03,257 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:03,259 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33621 2837s 2024-11-24 00:45:03,259 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33621 2837s 2024-11-24 00:45:03,259 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:03,259 - distributed.worker - INFO - dashboard at: 127.0.0.1:33249 2837s 2024-11-24 00:45:03,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46315 2837s 2024-11-24 00:45:03,259 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:03,259 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:03,259 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:03,259 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qk_npak4 2837s 2024-11-24 00:45:03,259 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:03,260 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43729. Reason: failure-to-start- 2837s 2024-11-24 00:45:03,260 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:03,261 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33621. Reason: failure-to-start- 2837s 2024-11-24 00:45:03,261 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:03,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46315': TLS handshake failed with remote 'tls://127.0.0.1:40844': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:03,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46315': TLS handshake failed with remote 'tls://127.0.0.1:40856': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:03,263 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:04,267 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:04,272 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45463 2837s 2024-11-24 00:45:04,272 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40991/status 2837s 2024-11-24 00:45:04,272 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:04,280 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36983 2837s 2024-11-24 00:45:04,280 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36983 2837s 2024-11-24 00:45:04,280 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:04,280 - distributed.worker - INFO - dashboard at: 127.0.0.1:40637 2837s 2024-11-24 00:45:04,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45463 2837s 2024-11-24 00:45:04,281 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:04,281 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:04,281 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:04,281 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9vir_gk9 2837s 2024-11-24 00:45:04,281 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:04,282 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42605 2837s 2024-11-24 00:45:04,283 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42605 2837s 2024-11-24 00:45:04,283 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:04,283 - distributed.worker - INFO - dashboard at: 127.0.0.1:44951 2837s 2024-11-24 00:45:04,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45463 2837s 2024-11-24 00:45:04,283 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:04,283 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:04,283 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:04,283 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-47r1a7ds 2837s 2024-11-24 00:45:04,283 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:04,284 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36983. Reason: failure-to-start- 2837s 2024-11-24 00:45:04,284 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:04,284 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42605. Reason: failure-to-start- 2837s 2024-11-24 00:45:04,284 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:04,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45463': TLS handshake failed with remote 'tls://127.0.0.1:47124': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:04,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45463': TLS handshake failed with remote 'tls://127.0.0.1:47126': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:04,286 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:05,291 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:05,294 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34833 2837s 2024-11-24 00:45:05,295 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36395/status 2837s 2024-11-24 00:45:05,295 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:05,304 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34829 2837s 2024-11-24 00:45:05,304 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34829 2837s 2024-11-24 00:45:05,304 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:05,304 - distributed.worker - INFO - dashboard at: 127.0.0.1:34491 2837s 2024-11-24 00:45:05,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34833 2837s 2024-11-24 00:45:05,304 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:05,305 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:05,305 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:05,305 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fy_ytvnk 2837s 2024-11-24 00:45:05,305 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:05,306 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42385 2837s 2024-11-24 00:45:05,306 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42385 2837s 2024-11-24 00:45:05,306 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:05,306 - distributed.worker - INFO - dashboard at: 127.0.0.1:40113 2837s 2024-11-24 00:45:05,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34833 2837s 2024-11-24 00:45:05,307 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:05,307 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:05,307 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:05,307 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h1exwmez 2837s 2024-11-24 00:45:05,307 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:05,308 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34829. Reason: failure-to-start- 2837s 2024-11-24 00:45:05,308 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:05,308 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42385. Reason: failure-to-start- 2837s 2024-11-24 00:45:05,308 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:05,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34833': TLS handshake failed with remote 'tls://127.0.0.1:59218': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:05,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34833': TLS handshake failed with remote 'tls://127.0.0.1:59228': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:05,310 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:06,314 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:06,318 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45711 2837s 2024-11-24 00:45:06,318 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42857/status 2837s 2024-11-24 00:45:06,318 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:06,326 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41577 2837s 2024-11-24 00:45:06,326 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41577 2837s 2024-11-24 00:45:06,326 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:06,326 - distributed.worker - INFO - dashboard at: 127.0.0.1:46583 2837s 2024-11-24 00:45:06,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45711 2837s 2024-11-24 00:45:06,327 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:06,327 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:06,327 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:06,327 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e4ua59vw 2837s 2024-11-24 00:45:06,327 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:06,329 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39563 2837s 2024-11-24 00:45:06,329 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39563 2837s 2024-11-24 00:45:06,329 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:06,329 - distributed.worker - INFO - dashboard at: 127.0.0.1:34927 2837s 2024-11-24 00:45:06,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45711 2837s 2024-11-24 00:45:06,329 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:06,330 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:06,330 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:06,330 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s48_s8px 2837s 2024-11-24 00:45:06,330 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:06,331 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41577. Reason: failure-to-start- 2837s 2024-11-24 00:45:06,331 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:06,331 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39563. Reason: failure-to-start- 2837s 2024-11-24 00:45:06,331 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:06,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45711': TLS handshake failed with remote 'tls://127.0.0.1:34568': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:06,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45711': TLS handshake failed with remote 'tls://127.0.0.1:34574': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:06,333 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:07,337 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:07,341 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39401 2837s 2024-11-24 00:45:07,341 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37543/status 2837s 2024-11-24 00:45:07,341 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:07,350 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46297 2837s 2024-11-24 00:45:07,350 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46297 2837s 2024-11-24 00:45:07,350 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:07,350 - distributed.worker - INFO - dashboard at: 127.0.0.1:46151 2837s 2024-11-24 00:45:07,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39401 2837s 2024-11-24 00:45:07,350 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:07,350 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:07,350 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:07,350 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_7f9gb2y 2837s 2024-11-24 00:45:07,350 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:07,352 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36409 2837s 2024-11-24 00:45:07,352 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36409 2837s 2024-11-24 00:45:07,352 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:07,352 - distributed.worker - INFO - dashboard at: 127.0.0.1:33801 2837s 2024-11-24 00:45:07,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39401 2837s 2024-11-24 00:45:07,352 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:07,352 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:07,352 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:07,353 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zw0hqq9m 2837s 2024-11-24 00:45:07,353 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:07,353 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46297. Reason: failure-to-start- 2837s 2024-11-24 00:45:07,354 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:07,354 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36409. Reason: failure-to-start- 2837s 2024-11-24 00:45:07,354 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:07,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39401': TLS handshake failed with remote 'tls://127.0.0.1:52484': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:07,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39401': TLS handshake failed with remote 'tls://127.0.0.1:52494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:07,356 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:08,361 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:08,365 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46857 2837s 2024-11-24 00:45:08,365 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41755/status 2837s 2024-11-24 00:45:08,365 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:08,373 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46019 2837s 2024-11-24 00:45:08,373 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46019 2837s 2024-11-24 00:45:08,373 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:08,373 - distributed.worker - INFO - dashboard at: 127.0.0.1:43175 2837s 2024-11-24 00:45:08,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46857 2837s 2024-11-24 00:45:08,374 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:08,374 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:08,374 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:08,374 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-343srvra 2837s 2024-11-24 00:45:08,374 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:08,375 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36479 2837s 2024-11-24 00:45:08,375 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36479 2837s 2024-11-24 00:45:08,375 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:08,375 - distributed.worker - INFO - dashboard at: 127.0.0.1:33419 2837s 2024-11-24 00:45:08,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46857 2837s 2024-11-24 00:45:08,376 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:08,376 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:08,376 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:08,376 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e1urocmk 2837s 2024-11-24 00:45:08,376 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:08,377 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46019. Reason: failure-to-start- 2837s 2024-11-24 00:45:08,377 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:08,377 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36479. Reason: failure-to-start- 2837s 2024-11-24 00:45:08,377 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:08,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46857': TLS handshake failed with remote 'tls://127.0.0.1:39718': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:08,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46857': TLS handshake failed with remote 'tls://127.0.0.1:39734': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:08,379 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:09,385 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:09,389 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35405 2837s 2024-11-24 00:45:09,389 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39993/status 2837s 2024-11-24 00:45:09,389 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:09,399 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45133 2837s 2024-11-24 00:45:09,399 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45133 2837s 2024-11-24 00:45:09,399 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:09,399 - distributed.worker - INFO - dashboard at: 127.0.0.1:41721 2837s 2024-11-24 00:45:09,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35405 2837s 2024-11-24 00:45:09,399 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:09,399 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:09,400 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:09,400 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iem3ejq3 2837s 2024-11-24 00:45:09,400 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:09,401 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40791 2837s 2024-11-24 00:45:09,402 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40791 2837s 2024-11-24 00:45:09,402 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:09,402 - distributed.worker - INFO - dashboard at: 127.0.0.1:43581 2837s 2024-11-24 00:45:09,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35405 2837s 2024-11-24 00:45:09,402 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:09,402 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:09,402 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:09,402 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-65fdo0xf 2837s 2024-11-24 00:45:09,402 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:09,403 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45133. Reason: failure-to-start- 2837s 2024-11-24 00:45:09,403 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:09,404 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40791. Reason: failure-to-start- 2837s 2024-11-24 00:45:09,404 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:09,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35405': TLS handshake failed with remote 'tls://127.0.0.1:39010': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:09,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35405': TLS handshake failed with remote 'tls://127.0.0.1:39026': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:09,406 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:10,411 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:10,415 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40657 2837s 2024-11-24 00:45:10,415 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44191/status 2837s 2024-11-24 00:45:10,416 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:10,424 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43287 2837s 2024-11-24 00:45:10,424 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43287 2837s 2024-11-24 00:45:10,424 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:10,424 - distributed.worker - INFO - dashboard at: 127.0.0.1:35955 2837s 2024-11-24 00:45:10,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40657 2837s 2024-11-24 00:45:10,425 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:10,425 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:10,425 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:10,425 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eg5hj56q 2837s 2024-11-24 00:45:10,425 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:10,436 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42497 2837s 2024-11-24 00:45:10,436 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42497 2837s 2024-11-24 00:45:10,436 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:10,437 - distributed.worker - INFO - dashboard at: 127.0.0.1:40329 2837s 2024-11-24 00:45:10,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40657 2837s 2024-11-24 00:45:10,437 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:10,437 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:10,437 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:10,437 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ax6_5jj4 2837s 2024-11-24 00:45:10,437 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:10,438 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43287. Reason: failure-to-start- 2837s 2024-11-24 00:45:10,438 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:10,438 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42497. Reason: failure-to-start- 2837s 2024-11-24 00:45:10,438 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:10,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40657': TLS handshake failed with remote 'tls://127.0.0.1:51970': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:10,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40657': TLS handshake failed with remote 'tls://127.0.0.1:51974': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:10,441 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:11,445 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:11,449 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43515 2837s 2024-11-24 00:45:11,449 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34763/status 2837s 2024-11-24 00:45:11,449 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:11,458 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42307 2837s 2024-11-24 00:45:11,458 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42307 2837s 2024-11-24 00:45:11,458 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:11,458 - distributed.worker - INFO - dashboard at: 127.0.0.1:38137 2837s 2024-11-24 00:45:11,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43515 2837s 2024-11-24 00:45:11,458 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:11,458 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:11,458 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:11,458 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q56lmkzo 2837s 2024-11-24 00:45:11,458 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:11,460 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42293 2837s 2024-11-24 00:45:11,460 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42293 2837s 2024-11-24 00:45:11,460 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:11,460 - distributed.worker - INFO - dashboard at: 127.0.0.1:45979 2837s 2024-11-24 00:45:11,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43515 2837s 2024-11-24 00:45:11,460 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:11,460 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:11,460 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:11,460 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gw32fpwr 2837s 2024-11-24 00:45:11,460 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:11,461 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42307. Reason: failure-to-start- 2837s 2024-11-24 00:45:11,461 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:11,462 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42293. Reason: failure-to-start- 2837s 2024-11-24 00:45:11,462 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:11,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43515': TLS handshake failed with remote 'tls://127.0.0.1:53350': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:11,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43515': TLS handshake failed with remote 'tls://127.0.0.1:53364': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:11,464 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:12,468 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:12,473 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42971 2837s 2024-11-24 00:45:12,473 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35857/status 2837s 2024-11-24 00:45:12,473 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:12,481 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34363 2837s 2024-11-24 00:45:12,482 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34363 2837s 2024-11-24 00:45:12,482 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:12,482 - distributed.worker - INFO - dashboard at: 127.0.0.1:34153 2837s 2024-11-24 00:45:12,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42971 2837s 2024-11-24 00:45:12,482 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:12,482 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:12,482 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:12,482 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kiggg9hd 2837s 2024-11-24 00:45:12,482 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:12,483 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38125 2837s 2024-11-24 00:45:12,484 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38125 2837s 2024-11-24 00:45:12,484 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:12,484 - distributed.worker - INFO - dashboard at: 127.0.0.1:44279 2837s 2024-11-24 00:45:12,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42971 2837s 2024-11-24 00:45:12,484 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:12,484 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:12,484 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:12,484 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3o9e5nay 2837s 2024-11-24 00:45:12,484 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:12,485 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34363. Reason: failure-to-start- 2837s 2024-11-24 00:45:12,485 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:12,485 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38125. Reason: failure-to-start- 2837s 2024-11-24 00:45:12,485 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:12,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42971': TLS handshake failed with remote 'tls://127.0.0.1:37760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:12,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42971': TLS handshake failed with remote 'tls://127.0.0.1:37770': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:12,487 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:13,492 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:13,496 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39199 2837s 2024-11-24 00:45:13,496 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36095/status 2837s 2024-11-24 00:45:13,496 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:13,506 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40573 2837s 2024-11-24 00:45:13,506 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40573 2837s 2024-11-24 00:45:13,506 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:13,506 - distributed.worker - INFO - dashboard at: 127.0.0.1:36197 2837s 2024-11-24 00:45:13,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39199 2837s 2024-11-24 00:45:13,506 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:13,506 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:13,506 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:13,506 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i1cl0wyb 2837s 2024-11-24 00:45:13,506 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:13,508 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41227 2837s 2024-11-24 00:45:13,508 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41227 2837s 2024-11-24 00:45:13,508 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:13,508 - distributed.worker - INFO - dashboard at: 127.0.0.1:34553 2837s 2024-11-24 00:45:13,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39199 2837s 2024-11-24 00:45:13,508 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:13,508 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:13,508 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:13,508 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-di044afz 2837s 2024-11-24 00:45:13,508 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:13,509 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40573. Reason: failure-to-start- 2837s 2024-11-24 00:45:13,509 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:13,510 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41227. Reason: failure-to-start- 2837s 2024-11-24 00:45:13,510 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:13,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39199': TLS handshake failed with remote 'tls://127.0.0.1:51844': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:13,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39199': TLS handshake failed with remote 'tls://127.0.0.1:51858': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:13,512 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:14,516 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:14,520 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33677 2837s 2024-11-24 00:45:14,520 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34201/status 2837s 2024-11-24 00:45:14,520 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:14,529 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43977 2837s 2024-11-24 00:45:14,529 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43977 2837s 2024-11-24 00:45:14,529 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:14,529 - distributed.worker - INFO - dashboard at: 127.0.0.1:37781 2837s 2024-11-24 00:45:14,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33677 2837s 2024-11-24 00:45:14,529 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:14,529 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:14,529 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:14,529 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sm3mna9t 2837s 2024-11-24 00:45:14,530 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:14,531 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41903 2837s 2024-11-24 00:45:14,531 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41903 2837s 2024-11-24 00:45:14,531 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:14,531 - distributed.worker - INFO - dashboard at: 127.0.0.1:43229 2837s 2024-11-24 00:45:14,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33677 2837s 2024-11-24 00:45:14,531 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:14,531 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:14,531 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:14,532 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1vf3cdv_ 2837s 2024-11-24 00:45:14,532 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:14,533 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43977. Reason: failure-to-start- 2837s 2024-11-24 00:45:14,534 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:14,534 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41903. Reason: failure-to-start- 2837s 2024-11-24 00:45:14,534 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:14,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33677': TLS handshake failed with remote 'tls://127.0.0.1:42086': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:14,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33677': TLS handshake failed with remote 'tls://127.0.0.1:42098': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:14,536 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:15,540 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:15,544 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33397 2837s 2024-11-24 00:45:15,544 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41349/status 2837s 2024-11-24 00:45:15,545 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:15,553 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32825 2837s 2024-11-24 00:45:15,553 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32825 2837s 2024-11-24 00:45:15,553 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:15,553 - distributed.worker - INFO - dashboard at: 127.0.0.1:43851 2837s 2024-11-24 00:45:15,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33397 2837s 2024-11-24 00:45:15,553 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:15,553 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:15,554 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:15,554 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c6ned0z9 2837s 2024-11-24 00:45:15,554 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:15,555 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34099 2837s 2024-11-24 00:45:15,555 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34099 2837s 2024-11-24 00:45:15,555 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:15,555 - distributed.worker - INFO - dashboard at: 127.0.0.1:41289 2837s 2024-11-24 00:45:15,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33397 2837s 2024-11-24 00:45:15,555 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:15,555 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:15,556 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:15,556 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cefbv4vh 2837s 2024-11-24 00:45:15,556 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:15,557 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32825. Reason: failure-to-start- 2837s 2024-11-24 00:45:15,557 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:15,557 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34099. Reason: failure-to-start- 2837s 2024-11-24 00:45:15,557 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:15,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33397': TLS handshake failed with remote 'tls://127.0.0.1:37426': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:15,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33397': TLS handshake failed with remote 'tls://127.0.0.1:37442': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:15,559 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:16,563 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:16,568 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35719 2837s 2024-11-24 00:45:16,568 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39437/status 2837s 2024-11-24 00:45:16,568 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:16,577 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35141 2837s 2024-11-24 00:45:16,577 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35141 2837s 2024-11-24 00:45:16,577 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:16,577 - distributed.worker - INFO - dashboard at: 127.0.0.1:40363 2837s 2024-11-24 00:45:16,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35719 2837s 2024-11-24 00:45:16,577 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:16,577 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:16,578 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:16,578 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-waopfdju 2837s 2024-11-24 00:45:16,578 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:16,579 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46381 2837s 2024-11-24 00:45:16,579 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46381 2837s 2024-11-24 00:45:16,579 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:16,579 - distributed.worker - INFO - dashboard at: 127.0.0.1:41889 2837s 2024-11-24 00:45:16,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35719 2837s 2024-11-24 00:45:16,579 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:16,580 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:16,580 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:16,580 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-81owsby5 2837s 2024-11-24 00:45:16,580 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:16,581 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35141. Reason: failure-to-start- 2837s 2024-11-24 00:45:16,581 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:16,581 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46381. Reason: failure-to-start- 2837s 2024-11-24 00:45:16,581 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:16,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35719': TLS handshake failed with remote 'tls://127.0.0.1:39416': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:16,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35719': TLS handshake failed with remote 'tls://127.0.0.1:39426': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:16,583 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:17,587 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:17,591 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35837 2837s 2024-11-24 00:45:17,591 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32971/status 2837s 2024-11-24 00:45:17,592 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:17,602 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34373 2837s 2024-11-24 00:45:17,602 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34373 2837s 2024-11-24 00:45:17,602 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:17,602 - distributed.worker - INFO - dashboard at: 127.0.0.1:43265 2837s 2024-11-24 00:45:17,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2837s 2024-11-24 00:45:17,602 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:17,602 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:17,602 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:17,602 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i_rem3cs 2837s 2024-11-24 00:45:17,602 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:17,604 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39633 2837s 2024-11-24 00:45:17,604 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39633 2837s 2024-11-24 00:45:17,604 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:17,604 - distributed.worker - INFO - dashboard at: 127.0.0.1:43395 2837s 2024-11-24 00:45:17,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35837 2837s 2024-11-24 00:45:17,604 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:17,604 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:17,604 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:17,604 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wsu6rrua 2837s 2024-11-24 00:45:17,604 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:17,606 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34373. Reason: failure-to-start- 2837s 2024-11-24 00:45:17,606 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:17,607 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39633. Reason: failure-to-start- 2837s 2024-11-24 00:45:17,607 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:17,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:37488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:17,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35837': TLS handshake failed with remote 'tls://127.0.0.1:37492': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:17,609 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:18,613 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:18,617 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45847 2837s 2024-11-24 00:45:18,617 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33997/status 2837s 2024-11-24 00:45:18,617 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:18,626 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39211 2837s 2024-11-24 00:45:18,626 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39211 2837s 2024-11-24 00:45:18,626 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:18,626 - distributed.worker - INFO - dashboard at: 127.0.0.1:37487 2837s 2024-11-24 00:45:18,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45847 2837s 2024-11-24 00:45:18,626 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:18,626 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:18,626 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:18,626 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i8s88snq 2837s 2024-11-24 00:45:18,627 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:18,629 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44153 2837s 2024-11-24 00:45:18,629 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44153 2837s 2024-11-24 00:45:18,629 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:18,629 - distributed.worker - INFO - dashboard at: 127.0.0.1:43839 2837s 2024-11-24 00:45:18,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45847 2837s 2024-11-24 00:45:18,629 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:18,629 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:18,630 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:18,630 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4tpct5gy 2837s 2024-11-24 00:45:18,630 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:18,631 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39211. Reason: failure-to-start- 2837s 2024-11-24 00:45:18,632 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:18,632 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44153. Reason: failure-to-start- 2837s 2024-11-24 00:45:18,632 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:18,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45847': TLS handshake failed with remote 'tls://127.0.0.1:32810': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:18,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45847': TLS handshake failed with remote 'tls://127.0.0.1:32824': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:18,634 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:19,641 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:19,644 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42929 2837s 2024-11-24 00:45:19,645 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34743/status 2837s 2024-11-24 00:45:19,645 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:19,653 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45809 2837s 2024-11-24 00:45:19,653 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45809 2837s 2024-11-24 00:45:19,654 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:19,654 - distributed.worker - INFO - dashboard at: 127.0.0.1:37631 2837s 2024-11-24 00:45:19,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42929 2837s 2024-11-24 00:45:19,654 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:19,654 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:19,654 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:19,654 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i24hk4og 2837s 2024-11-24 00:45:19,654 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:19,655 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38091 2837s 2024-11-24 00:45:19,656 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38091 2837s 2024-11-24 00:45:19,656 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:19,656 - distributed.worker - INFO - dashboard at: 127.0.0.1:45657 2837s 2024-11-24 00:45:19,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42929 2837s 2024-11-24 00:45:19,656 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:19,656 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:19,656 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:19,656 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-596z7bff 2837s 2024-11-24 00:45:19,656 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:19,657 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45809. Reason: failure-to-start- 2837s 2024-11-24 00:45:19,657 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:19,657 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38091. Reason: failure-to-start- 2837s 2024-11-24 00:45:19,658 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:19,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42929': TLS handshake failed with remote 'tls://127.0.0.1:48710': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:19,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42929': TLS handshake failed with remote 'tls://127.0.0.1:48714': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:19,661 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:20,665 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:20,671 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43015 2837s 2024-11-24 00:45:20,671 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40049/status 2837s 2024-11-24 00:45:20,671 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:20,680 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43355 2837s 2024-11-24 00:45:20,680 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43355 2837s 2024-11-24 00:45:20,680 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:20,680 - distributed.worker - INFO - dashboard at: 127.0.0.1:45347 2837s 2024-11-24 00:45:20,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43015 2837s 2024-11-24 00:45:20,680 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:20,680 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:20,680 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:20,680 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2z2z0exd 2837s 2024-11-24 00:45:20,680 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:20,682 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42253 2837s 2024-11-24 00:45:20,682 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42253 2837s 2024-11-24 00:45:20,682 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:20,682 - distributed.worker - INFO - dashboard at: 127.0.0.1:45675 2837s 2024-11-24 00:45:20,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43015 2837s 2024-11-24 00:45:20,682 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:20,683 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:20,683 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:20,683 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-whxc1gok 2837s 2024-11-24 00:45:20,683 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:20,684 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43355. Reason: failure-to-start- 2837s 2024-11-24 00:45:20,684 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:20,684 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42253. Reason: failure-to-start- 2837s 2024-11-24 00:45:20,684 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:20,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43015': TLS handshake failed with remote 'tls://127.0.0.1:45756': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:20,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43015': TLS handshake failed with remote 'tls://127.0.0.1:45764': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:20,687 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:21,692 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:21,696 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42719 2837s 2024-11-24 00:45:21,696 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44807/status 2837s 2024-11-24 00:45:21,696 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:21,706 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35999 2837s 2024-11-24 00:45:21,706 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35999 2837s 2024-11-24 00:45:21,706 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:21,706 - distributed.worker - INFO - dashboard at: 127.0.0.1:36839 2837s 2024-11-24 00:45:21,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42719 2837s 2024-11-24 00:45:21,707 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:21,707 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:21,707 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:21,707 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ih83_ei9 2837s 2024-11-24 00:45:21,707 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:21,708 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44751 2837s 2024-11-24 00:45:21,708 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44751 2837s 2024-11-24 00:45:21,708 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:21,709 - distributed.worker - INFO - dashboard at: 127.0.0.1:38443 2837s 2024-11-24 00:45:21,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42719 2837s 2024-11-24 00:45:21,709 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:21,709 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:21,709 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:21,709 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1d82fyl2 2837s 2024-11-24 00:45:21,709 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:21,711 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35999. Reason: failure-to-start- 2837s 2024-11-24 00:45:21,711 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:21,711 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44751. Reason: failure-to-start- 2837s 2024-11-24 00:45:21,711 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:21,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42719': TLS handshake failed with remote 'tls://127.0.0.1:35512': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:21,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42719': TLS handshake failed with remote 'tls://127.0.0.1:35520': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:21,713 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:22,718 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:22,722 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44789 2837s 2024-11-24 00:45:22,722 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42485/status 2837s 2024-11-24 00:45:22,722 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:22,730 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44213 2837s 2024-11-24 00:45:22,731 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44213 2837s 2024-11-24 00:45:22,731 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:22,731 - distributed.worker - INFO - dashboard at: 127.0.0.1:44619 2837s 2024-11-24 00:45:22,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44789 2837s 2024-11-24 00:45:22,731 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:22,731 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:22,731 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:22,731 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-esan3ehi 2837s 2024-11-24 00:45:22,731 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:22,734 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43053 2837s 2024-11-24 00:45:22,734 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43053 2837s 2024-11-24 00:45:22,734 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:22,734 - distributed.worker - INFO - dashboard at: 127.0.0.1:42685 2837s 2024-11-24 00:45:22,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44789 2837s 2024-11-24 00:45:22,734 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:22,734 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:22,734 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:22,734 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n7n3ibm6 2837s 2024-11-24 00:45:22,734 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:22,736 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44213. Reason: failure-to-start- 2837s 2024-11-24 00:45:22,736 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:22,736 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43053. Reason: failure-to-start- 2837s 2024-11-24 00:45:22,737 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:22,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44789': TLS handshake failed with remote 'tls://127.0.0.1:40248': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:22,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44789': TLS handshake failed with remote 'tls://127.0.0.1:40252': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:22,738 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:23,743 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:23,747 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42909 2837s 2024-11-24 00:45:23,747 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46391/status 2837s 2024-11-24 00:45:23,747 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:23,756 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41421 2837s 2024-11-24 00:45:23,756 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41421 2837s 2024-11-24 00:45:23,756 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:23,756 - distributed.worker - INFO - dashboard at: 127.0.0.1:36835 2837s 2024-11-24 00:45:23,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42909 2837s 2024-11-24 00:45:23,756 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:23,756 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:23,756 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:23,756 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cjjvubid 2837s 2024-11-24 00:45:23,756 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:23,758 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35655 2837s 2024-11-24 00:45:23,758 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35655 2837s 2024-11-24 00:45:23,758 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:23,758 - distributed.worker - INFO - dashboard at: 127.0.0.1:39151 2837s 2024-11-24 00:45:23,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42909 2837s 2024-11-24 00:45:23,758 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:23,758 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:23,758 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:23,758 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c42zvn1_ 2837s 2024-11-24 00:45:23,758 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:23,760 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41421. Reason: failure-to-start- 2837s 2024-11-24 00:45:23,760 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:23,760 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35655. Reason: failure-to-start- 2837s 2024-11-24 00:45:23,761 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:23,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42909': TLS handshake failed with remote 'tls://127.0.0.1:45054': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:23,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42909': TLS handshake failed with remote 'tls://127.0.0.1:45062': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:23,763 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:24,767 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:24,773 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36657 2837s 2024-11-24 00:45:24,773 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43827/status 2837s 2024-11-24 00:45:24,773 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:24,784 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39165 2837s 2024-11-24 00:45:24,784 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39165 2837s 2024-11-24 00:45:24,784 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:24,784 - distributed.worker - INFO - dashboard at: 127.0.0.1:44395 2837s 2024-11-24 00:45:24,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36657 2837s 2024-11-24 00:45:24,784 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:24,784 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:24,784 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:24,784 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cix8eha4 2837s 2024-11-24 00:45:24,784 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:24,786 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42325 2837s 2024-11-24 00:45:24,786 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42325 2837s 2024-11-24 00:45:24,786 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:24,786 - distributed.worker - INFO - dashboard at: 127.0.0.1:38447 2837s 2024-11-24 00:45:24,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36657 2837s 2024-11-24 00:45:24,786 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:24,786 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:24,787 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:24,787 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kgfjfy8u 2837s 2024-11-24 00:45:24,787 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:24,788 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39165. Reason: failure-to-start- 2837s 2024-11-24 00:45:24,788 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:24,788 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42325. Reason: failure-to-start- 2837s 2024-11-24 00:45:24,788 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:24,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36657': TLS handshake failed with remote 'tls://127.0.0.1:42114': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:24,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36657': TLS handshake failed with remote 'tls://127.0.0.1:42116': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:24,790 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:25,794 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:25,799 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45043 2837s 2024-11-24 00:45:25,799 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38007/status 2837s 2024-11-24 00:45:25,799 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:25,811 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37385 2837s 2024-11-24 00:45:25,811 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37385 2837s 2024-11-24 00:45:25,811 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:25,811 - distributed.worker - INFO - dashboard at: 127.0.0.1:45665 2837s 2024-11-24 00:45:25,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45043 2837s 2024-11-24 00:45:25,811 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:25,811 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:25,811 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:25,811 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5qaickn0 2837s 2024-11-24 00:45:25,812 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:25,813 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35097 2837s 2024-11-24 00:45:25,813 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35097 2837s 2024-11-24 00:45:25,813 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:25,813 - distributed.worker - INFO - dashboard at: 127.0.0.1:36629 2837s 2024-11-24 00:45:25,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45043 2837s 2024-11-24 00:45:25,814 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:25,814 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:25,814 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:25,814 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y7phdh71 2837s 2024-11-24 00:45:25,814 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:25,815 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37385. Reason: failure-to-start- 2837s 2024-11-24 00:45:25,815 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:25,815 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35097. Reason: failure-to-start- 2837s 2024-11-24 00:45:25,815 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:25,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45043': TLS handshake failed with remote 'tls://127.0.0.1:40988': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:25,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45043': TLS handshake failed with remote 'tls://127.0.0.1:40994': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:25,817 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:26,823 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:26,827 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34055 2837s 2024-11-24 00:45:26,827 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34635/status 2837s 2024-11-24 00:45:26,827 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:26,836 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36373 2837s 2024-11-24 00:45:26,836 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36373 2837s 2024-11-24 00:45:26,836 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:26,837 - distributed.worker - INFO - dashboard at: 127.0.0.1:38057 2837s 2024-11-24 00:45:26,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34055 2837s 2024-11-24 00:45:26,837 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:26,837 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:26,837 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:26,837 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kmnjmwq1 2837s 2024-11-24 00:45:26,837 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:26,851 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40123 2837s 2024-11-24 00:45:26,851 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40123 2837s 2024-11-24 00:45:26,851 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:26,851 - distributed.worker - INFO - dashboard at: 127.0.0.1:42249 2837s 2024-11-24 00:45:26,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34055 2837s 2024-11-24 00:45:26,851 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:26,852 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:26,852 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:26,852 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vqlmhb0y 2837s 2024-11-24 00:45:26,852 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:26,853 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36373. Reason: failure-to-start- 2837s 2024-11-24 00:45:26,853 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:26,853 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40123. Reason: failure-to-start- 2837s 2024-11-24 00:45:26,853 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:26,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34055': TLS handshake failed with remote 'tls://127.0.0.1:55572': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:26,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34055': TLS handshake failed with remote 'tls://127.0.0.1:55586': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:26,857 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:27,862 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:27,866 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37367 2837s 2024-11-24 00:45:27,866 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44359/status 2837s 2024-11-24 00:45:27,866 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:27,876 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45493 2837s 2024-11-24 00:45:27,876 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45493 2837s 2024-11-24 00:45:27,876 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:27,876 - distributed.worker - INFO - dashboard at: 127.0.0.1:35415 2837s 2024-11-24 00:45:27,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37367 2837s 2024-11-24 00:45:27,876 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:27,876 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:27,876 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:27,877 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zmm_dsaa 2837s 2024-11-24 00:45:27,877 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:27,878 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41389 2837s 2024-11-24 00:45:27,878 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41389 2837s 2024-11-24 00:45:27,878 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:27,878 - distributed.worker - INFO - dashboard at: 127.0.0.1:37203 2837s 2024-11-24 00:45:27,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37367 2837s 2024-11-24 00:45:27,879 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:27,879 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:27,879 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:27,879 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-85lecs_f 2837s 2024-11-24 00:45:27,879 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:27,880 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45493. Reason: failure-to-start- 2837s 2024-11-24 00:45:27,880 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:27,880 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41389. Reason: failure-to-start- 2837s 2024-11-24 00:45:27,880 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:27,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37367': TLS handshake failed with remote 'tls://127.0.0.1:53648': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:27,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37367': TLS handshake failed with remote 'tls://127.0.0.1:53658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:27,882 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s ______________________________ test_client_submit ______________________________ 2837s 2837s fut = , timeout = 0 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 2837s await self._register_with_scheduler() 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2837s comm = await wait_for( 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2837s return await fut 2837s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 2837s stream = await self.client.connect( 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s host = '127.0.0.1', port = 45091, af = 2837s ssl_options = 2837s max_buffer_size = 4151066624.0, source_ip = None, source_port = None 2837s timeout = None 2837s 2837s async def connect( 2837s self, 2837s host: str, 2837s port: int, 2837s af: socket.AddressFamily = socket.AF_UNSPEC, 2837s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 2837s max_buffer_size: Optional[int] = None, 2837s source_ip: Optional[str] = None, 2837s source_port: Optional[int] = None, 2837s timeout: Optional[Union[float, datetime.timedelta]] = None, 2837s ) -> IOStream: 2837s """Connect to the given host and port. 2837s 2837s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 2837s ``ssl_options`` is not None). 2837s 2837s Using the ``source_ip`` kwarg, one can specify the source 2837s IP address to use when establishing the connection. 2837s In case the user needs to resolve and 2837s use a specific interface, it has to be handled outside 2837s of Tornado as this depends very much on the platform. 2837s 2837s Raises `TimeoutError` if the input future does not complete before 2837s ``timeout``, which may be specified in any form allowed by 2837s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 2837s relative to `.IOLoop.time`) 2837s 2837s Similarly, when the user requires a certain source port, it can 2837s be specified using the ``source_port`` arg. 2837s 2837s .. versionchanged:: 4.5 2837s Added the ``source_ip`` and ``source_port`` arguments. 2837s 2837s .. versionchanged:: 5.0 2837s Added the ``timeout`` argument. 2837s """ 2837s if timeout is not None: 2837s if isinstance(timeout, numbers.Real): 2837s timeout = IOLoop.current().time() + timeout 2837s elif isinstance(timeout, datetime.timedelta): 2837s timeout = IOLoop.current().time() + timeout.total_seconds() 2837s else: 2837s raise TypeError("Unsupported timeout %r" % timeout) 2837s if timeout is not None: 2837s addrinfo = await gen.with_timeout( 2837s timeout, self.resolver.resolve(host, port, af) 2837s ) 2837s else: 2837s addrinfo = await self.resolver.resolve(host, port, af) 2837s connector = _Connector( 2837s addrinfo, 2837s functools.partial( 2837s self._create_stream, 2837s max_buffer_size, 2837s source_ip=source_ip, 2837s source_port=source_port, 2837s ), 2837s ) 2837s > af, addr, stream = await connector.start(connect_timeout=timeout) 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s > await wait_for(self.start_unsafe(), timeout=timeout) 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:664: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s @contextlib.asynccontextmanager 2837s async def _cluster_factory(): 2837s workers = [] 2837s s = None 2837s try: 2837s for _ in range(60): 2837s try: 2837s > s, ws = await start_cluster( 2837s nthreads, 2837s scheduler, 2837s security=security, 2837s Worker=Worker, 2837s scheduler_kwargs=scheduler_kwargs, 2837s worker_kwargs=merge( 2837s {"death_timeout": min(15, int(deadline.remaining))}, 2837s worker_kwargs, 2837s ), 2837s ) 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 2837s await asyncio.gather(*workers) 2837s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 2837s return await awaitable 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s except asyncio.TimeoutError as exc: 2837s await _close_on_failure(exc) 2837s > raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s E TimeoutError: Worker start timed out after 0s. 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s fut = ._..test_func..async_fn at 0xe63f7717abc0> 2837s timeout = 60 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 2837s _cluster_factory() as (s, workers), 2837s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 2837s return await anext(self.gen) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 2837s await asyncio.sleep(1) 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s delay = 1, result = None 2837s 2837s async def sleep(delay, result=None): 2837s """Coroutine that completes after a given time (in seconds).""" 2837s if delay <= 0: 2837s await __sleep0() 2837s return result 2837s 2837s if math.isnan(delay): 2837s raise ValueError("Invalid delay: NaN (not a number)") 2837s 2837s loop = events.get_running_loop() 2837s future = loop.create_future() 2837s h = loop.call_later(delay, 2837s futures._set_result_unless_cancelled, 2837s future, result) 2837s try: 2837s > return await future 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s args = (), kwds = {} 2837s 2837s @wraps(func) 2837s def inner(*args, **kwds): 2837s with self._recreate_cm(): 2837s > return func(*args, **kwds) 2837s 2837s /usr/lib/python3.13/contextlib.py:85: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3.13/contextlib.py:85: in inner 2837s return func(*args, **kwds) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 2837s return _run_and_close_tornado(async_fn_outer) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 2837s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 2837s /usr/lib/python3.13/asyncio/runners.py:194: in run 2837s return runner.run(main) 2837s /usr/lib/python3.13/asyncio/runners.py:118: in run 2837s return self._loop.run_until_complete(task) 2837s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 2837s return future.result() 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 2837s return await async_fn(*args, **kwargs) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 2837s return await utils_wait_for(async_fn(), timeout=timeout * 2) 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s ----------------------------- Captured stderr call ----------------------------- 2837s 2024-11-24 00:45:28,537 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:28,541 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:28,541 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43051/status 2837s 2024-11-24 00:45:28,541 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:28,550 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40493 2837s 2024-11-24 00:45:28,550 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40493 2837s 2024-11-24 00:45:28,550 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:28,550 - distributed.worker - INFO - dashboard at: 127.0.0.1:33077 2837s 2024-11-24 00:45:28,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:28,550 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:28,550 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:28,550 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:28,550 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-madm90uw 2837s 2024-11-24 00:45:28,550 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:28,552 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33951 2837s 2024-11-24 00:45:28,552 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33951 2837s 2024-11-24 00:45:28,552 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:28,552 - distributed.worker - INFO - dashboard at: 127.0.0.1:40051 2837s 2024-11-24 00:45:28,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:28,552 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:28,552 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:28,552 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:28,552 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8k5f5ldv 2837s 2024-11-24 00:45:28,552 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:28,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:28,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:28,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:28,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:28,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:28,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:28,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:28,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:28,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:28,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:28,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:28,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:28,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:28,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:28,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:28,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:29,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:29,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:40998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:30,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:30,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:31,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:31,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:32,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:32,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:33,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:33,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:34,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:34,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:41764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:35,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:35,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:58998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:36,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:36,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:37,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:37,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:38,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:38,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:39,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:39,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:40,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:40,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:41,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:41,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:59990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:42,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:42,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:43,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:43,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:43,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:43,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:43,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:43,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:43,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:43,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:43,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:43,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:43,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:43,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:43,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:43,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:43,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:43,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:43,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:43,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:43,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45457 2837s 2024-11-24 00:45:43,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45457': TLS handshake failed with remote 'tls://127.0.0.1:60144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:43,549 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40493. Reason: failure-to-start- 2837s 2024-11-24 00:45:43,550 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:43,551 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 15s. 2837s 2024-11-24 00:45:43,554 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33951. Reason: failure-to-start- 2837s 2024-11-24 00:45:43,554 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:44,557 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:44,562 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:44,562 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45959/status 2837s 2024-11-24 00:45:44,562 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:44,571 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42595 2837s 2024-11-24 00:45:44,572 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42595 2837s 2024-11-24 00:45:44,572 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:44,572 - distributed.worker - INFO - dashboard at: 127.0.0.1:43659 2837s 2024-11-24 00:45:44,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:44,572 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:44,572 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:44,572 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:44,572 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7muqan8m 2837s 2024-11-24 00:45:44,572 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:44,574 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45455 2837s 2024-11-24 00:45:44,574 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45455 2837s 2024-11-24 00:45:44,574 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:44,574 - distributed.worker - INFO - dashboard at: 127.0.0.1:42325 2837s 2024-11-24 00:45:44,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:44,574 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:44,574 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:44,574 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:44,574 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-em87414p 2837s 2024-11-24 00:45:44,574 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:44,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:44,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:44,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:58602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:44,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:58608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:44,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:44,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:44,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:58610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:44,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:58624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:44,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:44,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:44,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:58632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:44,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:58634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:44,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:44,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:44,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:58644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:44,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:58656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:58670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:58678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:58694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:58698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:58714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:58724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:45,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:45,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:51998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:46,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:46,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:47,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:47,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:48,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:48,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:49,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:49,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:50,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:50,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:52992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:51,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:51,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:52,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:52,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:53,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:53,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:54,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:54,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:55,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:55,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:56,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:56,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:57,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:57,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:57,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:57,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:57,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:57,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:57,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:57,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:57,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:57,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:57,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:57,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:57,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:57,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:57,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:57,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:57,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:57,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:57,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 2837s 2024-11-24 00:45:57,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:45:57,571 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42595. Reason: failure-to-start- 2837s 2024-11-24 00:45:57,571 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:57,573 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 13s. 2837s 2024-11-24 00:45:57,576 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45455. Reason: failure-to-start- 2837s 2024-11-24 00:45:57,576 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:58,578 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:58,582 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46437 2837s 2024-11-24 00:45:58,583 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33613/status 2837s 2024-11-24 00:45:58,583 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:58,592 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38093 2837s 2024-11-24 00:45:58,592 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38093 2837s 2024-11-24 00:45:58,592 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:58,592 - distributed.worker - INFO - dashboard at: 127.0.0.1:37627 2837s 2024-11-24 00:45:58,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46437 2837s 2024-11-24 00:45:58,592 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:58,592 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:58,593 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:58,593 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-48ogsetb 2837s 2024-11-24 00:45:58,593 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:58,594 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35971 2837s 2024-11-24 00:45:58,594 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35971 2837s 2024-11-24 00:45:58,594 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:58,594 - distributed.worker - INFO - dashboard at: 127.0.0.1:39923 2837s 2024-11-24 00:45:58,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46437 2837s 2024-11-24 00:45:58,594 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:58,595 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:58,595 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:58,595 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qj_i7mtt 2837s 2024-11-24 00:45:58,595 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:58,595 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38093. Reason: failure-to-start- 2837s 2024-11-24 00:45:58,596 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:58,596 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35971. Reason: failure-to-start- 2837s 2024-11-24 00:45:58,596 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:58,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46437': TLS handshake failed with remote 'tls://127.0.0.1:37594': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:58,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46437': TLS handshake failed with remote 'tls://127.0.0.1:37602': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:58,598 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:45:59,602 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:45:59,606 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34629 2837s 2024-11-24 00:45:59,606 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45359/status 2837s 2024-11-24 00:45:59,606 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:45:59,614 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42447 2837s 2024-11-24 00:45:59,614 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42447 2837s 2024-11-24 00:45:59,614 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:45:59,614 - distributed.worker - INFO - dashboard at: 127.0.0.1:39139 2837s 2024-11-24 00:45:59,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34629 2837s 2024-11-24 00:45:59,614 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:59,615 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:45:59,615 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:59,615 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rcm1i_02 2837s 2024-11-24 00:45:59,615 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:59,616 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35291 2837s 2024-11-24 00:45:59,616 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35291 2837s 2024-11-24 00:45:59,616 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:45:59,616 - distributed.worker - INFO - dashboard at: 127.0.0.1:43701 2837s 2024-11-24 00:45:59,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34629 2837s 2024-11-24 00:45:59,616 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:59,617 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:45:59,617 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:45:59,617 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d1dbyc0o 2837s 2024-11-24 00:45:59,617 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:45:59,617 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42447. Reason: failure-to-start- 2837s 2024-11-24 00:45:59,618 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:59,618 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35291. Reason: failure-to-start- 2837s 2024-11-24 00:45:59,618 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:45:59,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34629': TLS handshake failed with remote 'tls://127.0.0.1:38116': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:59,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34629': TLS handshake failed with remote 'tls://127.0.0.1:38118': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:45:59,620 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:00,625 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:00,629 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42465 2837s 2024-11-24 00:46:00,630 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37315/status 2837s 2024-11-24 00:46:00,630 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:00,638 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45953 2837s 2024-11-24 00:46:00,638 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45953 2837s 2024-11-24 00:46:00,638 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:00,638 - distributed.worker - INFO - dashboard at: 127.0.0.1:43407 2837s 2024-11-24 00:46:00,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42465 2837s 2024-11-24 00:46:00,638 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:00,638 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:00,638 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:00,638 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z33pyq3b 2837s 2024-11-24 00:46:00,638 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:00,640 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41277 2837s 2024-11-24 00:46:00,640 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41277 2837s 2024-11-24 00:46:00,640 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:00,640 - distributed.worker - INFO - dashboard at: 127.0.0.1:33815 2837s 2024-11-24 00:46:00,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42465 2837s 2024-11-24 00:46:00,640 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:00,640 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:00,640 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:00,640 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jmnhmeec 2837s 2024-11-24 00:46:00,640 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:00,641 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45953. Reason: failure-to-start- 2837s 2024-11-24 00:46:00,641 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:00,641 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41277. Reason: failure-to-start- 2837s 2024-11-24 00:46:00,641 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:00,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42465': TLS handshake failed with remote 'tls://127.0.0.1:45690': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:00,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42465': TLS handshake failed with remote 'tls://127.0.0.1:45700': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:00,643 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:01,648 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:01,652 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36955 2837s 2024-11-24 00:46:01,652 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40317/status 2837s 2024-11-24 00:46:01,653 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:01,662 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37977 2837s 2024-11-24 00:46:01,662 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37977 2837s 2024-11-24 00:46:01,662 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:01,663 - distributed.worker - INFO - dashboard at: 127.0.0.1:37725 2837s 2024-11-24 00:46:01,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36955 2837s 2024-11-24 00:46:01,663 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:01,663 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:01,663 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:01,663 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pkxf_a6s 2837s 2024-11-24 00:46:01,663 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:01,664 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42469 2837s 2024-11-24 00:46:01,665 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42469 2837s 2024-11-24 00:46:01,665 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:01,665 - distributed.worker - INFO - dashboard at: 127.0.0.1:45485 2837s 2024-11-24 00:46:01,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36955 2837s 2024-11-24 00:46:01,665 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:01,665 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:01,665 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:01,665 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yjtzs1iy 2837s 2024-11-24 00:46:01,665 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:01,666 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37977. Reason: failure-to-start- 2837s 2024-11-24 00:46:01,666 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:01,666 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42469. Reason: failure-to-start- 2837s 2024-11-24 00:46:01,666 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:01,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36955': TLS handshake failed with remote 'tls://127.0.0.1:55584': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:01,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36955': TLS handshake failed with remote 'tls://127.0.0.1:55590': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:01,668 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:02,673 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:02,677 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39349 2837s 2024-11-24 00:46:02,677 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34041/status 2837s 2024-11-24 00:46:02,677 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:02,687 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38413 2837s 2024-11-24 00:46:02,687 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38413 2837s 2024-11-24 00:46:02,687 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:02,688 - distributed.worker - INFO - dashboard at: 127.0.0.1:42255 2837s 2024-11-24 00:46:02,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39349 2837s 2024-11-24 00:46:02,688 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:02,688 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:02,688 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:02,688 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8no1nt71 2837s 2024-11-24 00:46:02,688 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:02,690 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46373 2837s 2024-11-24 00:46:02,690 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46373 2837s 2024-11-24 00:46:02,690 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:02,690 - distributed.worker - INFO - dashboard at: 127.0.0.1:41715 2837s 2024-11-24 00:46:02,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39349 2837s 2024-11-24 00:46:02,690 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:02,690 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:02,690 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:02,690 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kfyrvefp 2837s 2024-11-24 00:46:02,690 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:02,691 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38413. Reason: failure-to-start- 2837s 2024-11-24 00:46:02,691 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:02,692 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46373. Reason: failure-to-start- 2837s 2024-11-24 00:46:02,692 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:02,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39349': TLS handshake failed with remote 'tls://127.0.0.1:41782': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:02,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39349': TLS handshake failed with remote 'tls://127.0.0.1:41798': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:02,694 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:03,699 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:03,704 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34151 2837s 2024-11-24 00:46:03,705 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43595/status 2837s 2024-11-24 00:46:03,705 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:03,714 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39707 2837s 2024-11-24 00:46:03,715 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39707 2837s 2024-11-24 00:46:03,715 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:03,715 - distributed.worker - INFO - dashboard at: 127.0.0.1:32807 2837s 2024-11-24 00:46:03,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34151 2837s 2024-11-24 00:46:03,715 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:03,715 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:03,715 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:03,715 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f5e1yu4t 2837s 2024-11-24 00:46:03,715 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:03,717 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42349 2837s 2024-11-24 00:46:03,717 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42349 2837s 2024-11-24 00:46:03,717 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:03,717 - distributed.worker - INFO - dashboard at: 127.0.0.1:35073 2837s 2024-11-24 00:46:03,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34151 2837s 2024-11-24 00:46:03,717 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:03,717 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:03,717 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:03,717 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ze1zud0f 2837s 2024-11-24 00:46:03,717 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:03,718 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39707. Reason: failure-to-start- 2837s 2024-11-24 00:46:03,718 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:03,719 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42349. Reason: failure-to-start- 2837s 2024-11-24 00:46:03,719 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:03,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34151': TLS handshake failed with remote 'tls://127.0.0.1:56060': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:03,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34151': TLS handshake failed with remote 'tls://127.0.0.1:56074': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:03,721 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:04,727 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:04,731 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34983 2837s 2024-11-24 00:46:04,732 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39929/status 2837s 2024-11-24 00:46:04,732 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:04,741 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42279 2837s 2024-11-24 00:46:04,741 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42279 2837s 2024-11-24 00:46:04,741 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:04,741 - distributed.worker - INFO - dashboard at: 127.0.0.1:44339 2837s 2024-11-24 00:46:04,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34983 2837s 2024-11-24 00:46:04,741 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:04,741 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:04,741 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:04,741 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bg3d8mtb 2837s 2024-11-24 00:46:04,741 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:04,743 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43475 2837s 2024-11-24 00:46:04,743 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43475 2837s 2024-11-24 00:46:04,743 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:04,743 - distributed.worker - INFO - dashboard at: 127.0.0.1:41027 2837s 2024-11-24 00:46:04,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34983 2837s 2024-11-24 00:46:04,743 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:04,744 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:04,744 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:04,744 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5equ34qi 2837s 2024-11-24 00:46:04,744 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:04,745 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42279. Reason: failure-to-start- 2837s 2024-11-24 00:46:04,745 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:04,745 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43475. Reason: failure-to-start- 2837s 2024-11-24 00:46:04,745 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:04,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34983': TLS handshake failed with remote 'tls://127.0.0.1:45618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:04,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34983': TLS handshake failed with remote 'tls://127.0.0.1:45626': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:04,747 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:05,752 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:05,756 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35079 2837s 2024-11-24 00:46:05,757 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40835/status 2837s 2024-11-24 00:46:05,757 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:05,767 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39117 2837s 2024-11-24 00:46:05,767 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39117 2837s 2024-11-24 00:46:05,767 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:05,767 - distributed.worker - INFO - dashboard at: 127.0.0.1:40525 2837s 2024-11-24 00:46:05,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35079 2837s 2024-11-24 00:46:05,767 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:05,767 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:05,767 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:05,768 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oova0t03 2837s 2024-11-24 00:46:05,768 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:05,769 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37939 2837s 2024-11-24 00:46:05,769 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37939 2837s 2024-11-24 00:46:05,770 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:05,770 - distributed.worker - INFO - dashboard at: 127.0.0.1:32939 2837s 2024-11-24 00:46:05,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35079 2837s 2024-11-24 00:46:05,770 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:05,770 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:05,770 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:05,770 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-923o6edi 2837s 2024-11-24 00:46:05,770 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:05,771 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39117. Reason: failure-to-start- 2837s 2024-11-24 00:46:05,771 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:05,771 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37939. Reason: failure-to-start- 2837s 2024-11-24 00:46:05,771 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:05,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35079': TLS handshake failed with remote 'tls://127.0.0.1:50510': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:05,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35079': TLS handshake failed with remote 'tls://127.0.0.1:50514': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:05,773 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:06,779 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:06,783 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33567 2837s 2024-11-24 00:46:06,783 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34527/status 2837s 2024-11-24 00:46:06,784 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:06,793 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42283 2837s 2024-11-24 00:46:06,793 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42283 2837s 2024-11-24 00:46:06,793 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:06,794 - distributed.worker - INFO - dashboard at: 127.0.0.1:37149 2837s 2024-11-24 00:46:06,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33567 2837s 2024-11-24 00:46:06,794 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:06,794 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:06,794 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:06,794 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-orm879wj 2837s 2024-11-24 00:46:06,794 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:06,795 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45473 2837s 2024-11-24 00:46:06,796 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45473 2837s 2024-11-24 00:46:06,796 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:06,796 - distributed.worker - INFO - dashboard at: 127.0.0.1:40169 2837s 2024-11-24 00:46:06,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33567 2837s 2024-11-24 00:46:06,796 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:06,796 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:06,796 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:06,796 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kfjlsi7_ 2837s 2024-11-24 00:46:06,796 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:06,797 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42283. Reason: failure-to-start- 2837s 2024-11-24 00:46:06,797 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:06,797 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45473. Reason: failure-to-start- 2837s 2024-11-24 00:46:06,798 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:06,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33567': TLS handshake failed with remote 'tls://127.0.0.1:37560': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:06,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33567': TLS handshake failed with remote 'tls://127.0.0.1:37576': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:06,800 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:07,804 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:07,808 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45867 2837s 2024-11-24 00:46:07,809 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36319/status 2837s 2024-11-24 00:46:07,809 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:07,818 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43705 2837s 2024-11-24 00:46:07,818 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43705 2837s 2024-11-24 00:46:07,818 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:07,818 - distributed.worker - INFO - dashboard at: 127.0.0.1:43339 2837s 2024-11-24 00:46:07,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45867 2837s 2024-11-24 00:46:07,818 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:07,818 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:07,818 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:07,819 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g2cxsy5_ 2837s 2024-11-24 00:46:07,819 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:07,820 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44487 2837s 2024-11-24 00:46:07,820 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44487 2837s 2024-11-24 00:46:07,820 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:07,821 - distributed.worker - INFO - dashboard at: 127.0.0.1:38611 2837s 2024-11-24 00:46:07,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45867 2837s 2024-11-24 00:46:07,821 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:07,821 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:07,821 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:07,821 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x5kb2lsr 2837s 2024-11-24 00:46:07,821 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:07,822 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43705. Reason: failure-to-start- 2837s 2024-11-24 00:46:07,822 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:07,822 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44487. Reason: failure-to-start- 2837s 2024-11-24 00:46:07,822 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:07,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45867': TLS handshake failed with remote 'tls://127.0.0.1:48450': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:07,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45867': TLS handshake failed with remote 'tls://127.0.0.1:48454': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:07,824 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:08,837 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:08,841 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44723 2837s 2024-11-24 00:46:08,841 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43119/status 2837s 2024-11-24 00:46:08,842 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:08,850 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40787 2837s 2024-11-24 00:46:08,851 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40787 2837s 2024-11-24 00:46:08,851 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:08,851 - distributed.worker - INFO - dashboard at: 127.0.0.1:34277 2837s 2024-11-24 00:46:08,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44723 2837s 2024-11-24 00:46:08,851 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:08,851 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:08,851 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:08,851 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tarm3njd 2837s 2024-11-24 00:46:08,851 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:08,852 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46721 2837s 2024-11-24 00:46:08,853 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46721 2837s 2024-11-24 00:46:08,853 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:08,853 - distributed.worker - INFO - dashboard at: 127.0.0.1:43231 2837s 2024-11-24 00:46:08,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44723 2837s 2024-11-24 00:46:08,853 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:08,853 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:08,853 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:08,853 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r0qb8tfy 2837s 2024-11-24 00:46:08,853 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:08,854 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40787. Reason: failure-to-start- 2837s 2024-11-24 00:46:08,854 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:08,854 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46721. Reason: failure-to-start- 2837s 2024-11-24 00:46:08,854 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:08,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44723': TLS handshake failed with remote 'tls://127.0.0.1:53164': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:08,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44723': TLS handshake failed with remote 'tls://127.0.0.1:53168': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:08,856 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:09,861 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:09,865 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45119 2837s 2024-11-24 00:46:09,866 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44471/status 2837s 2024-11-24 00:46:09,866 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:10,305 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41631 2837s 2024-11-24 00:46:10,305 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41631 2837s 2024-11-24 00:46:10,305 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:10,305 - distributed.worker - INFO - dashboard at: 127.0.0.1:40819 2837s 2024-11-24 00:46:10,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45119 2837s 2024-11-24 00:46:10,305 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:10,305 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:10,305 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:10,305 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p7rky6ww 2837s 2024-11-24 00:46:10,305 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:10,307 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46125 2837s 2024-11-24 00:46:10,307 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46125 2837s 2024-11-24 00:46:10,307 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:10,307 - distributed.worker - INFO - dashboard at: 127.0.0.1:34765 2837s 2024-11-24 00:46:10,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45119 2837s 2024-11-24 00:46:10,307 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:10,307 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:10,307 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:10,307 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cyjj8_sp 2837s 2024-11-24 00:46:10,307 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:10,314 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41631. Reason: failure-to-start- 2837s 2024-11-24 00:46:10,314 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:10,315 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46125. Reason: failure-to-start- 2837s 2024-11-24 00:46:10,315 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:10,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45119': TLS handshake failed with remote 'tls://127.0.0.1:41308': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:10,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45119': TLS handshake failed with remote 'tls://127.0.0.1:41314': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:10,318 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:11,323 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:11,326 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33935 2837s 2024-11-24 00:46:11,326 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39665/status 2837s 2024-11-24 00:46:11,327 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:11,335 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33641 2837s 2024-11-24 00:46:11,335 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33641 2837s 2024-11-24 00:46:11,335 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:11,335 - distributed.worker - INFO - dashboard at: 127.0.0.1:34173 2837s 2024-11-24 00:46:11,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33935 2837s 2024-11-24 00:46:11,335 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:11,335 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:11,335 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:11,335 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iotq420_ 2837s 2024-11-24 00:46:11,335 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:11,336 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38757 2837s 2024-11-24 00:46:11,336 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38757 2837s 2024-11-24 00:46:11,336 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:11,337 - distributed.worker - INFO - dashboard at: 127.0.0.1:34053 2837s 2024-11-24 00:46:11,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33935 2837s 2024-11-24 00:46:11,337 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:11,337 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:11,337 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:11,337 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b34jh2w_ 2837s 2024-11-24 00:46:11,337 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:11,338 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33641. Reason: failure-to-start- 2837s 2024-11-24 00:46:11,338 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:11,338 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38757. Reason: failure-to-start- 2837s 2024-11-24 00:46:11,338 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:11,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33935': TLS handshake failed with remote 'tls://127.0.0.1:53346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:11,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33935': TLS handshake failed with remote 'tls://127.0.0.1:53360': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:11,340 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:12,345 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:12,350 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39549 2837s 2024-11-24 00:46:12,350 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41757/status 2837s 2024-11-24 00:46:12,351 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:12,358 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34149 2837s 2024-11-24 00:46:12,358 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34149 2837s 2024-11-24 00:46:12,358 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:12,358 - distributed.worker - INFO - dashboard at: 127.0.0.1:46825 2837s 2024-11-24 00:46:12,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39549 2837s 2024-11-24 00:46:12,359 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:12,359 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:12,359 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:12,359 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x9efmgrr 2837s 2024-11-24 00:46:12,359 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:12,360 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35241 2837s 2024-11-24 00:46:12,360 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35241 2837s 2024-11-24 00:46:12,360 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:12,360 - distributed.worker - INFO - dashboard at: 127.0.0.1:36781 2837s 2024-11-24 00:46:12,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39549 2837s 2024-11-24 00:46:12,360 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:12,360 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:12,360 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:12,360 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vko19hm3 2837s 2024-11-24 00:46:12,360 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:12,361 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34149. Reason: failure-to-start- 2837s 2024-11-24 00:46:12,361 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:12,362 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35241. Reason: failure-to-start- 2837s 2024-11-24 00:46:12,362 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:12,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39549': TLS handshake failed with remote 'tls://127.0.0.1:51272': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:12,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39549': TLS handshake failed with remote 'tls://127.0.0.1:51276': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:12,363 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:13,369 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:13,372 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41037 2837s 2024-11-24 00:46:13,373 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45607/status 2837s 2024-11-24 00:46:13,374 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:13,384 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45065 2837s 2024-11-24 00:46:13,384 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45065 2837s 2024-11-24 00:46:13,384 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:13,384 - distributed.worker - INFO - dashboard at: 127.0.0.1:36505 2837s 2024-11-24 00:46:13,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41037 2837s 2024-11-24 00:46:13,384 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:13,384 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:13,384 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:13,384 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7_7amexw 2837s 2024-11-24 00:46:13,384 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:13,386 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35423 2837s 2024-11-24 00:46:13,386 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35423 2837s 2024-11-24 00:46:13,386 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:13,386 - distributed.worker - INFO - dashboard at: 127.0.0.1:42347 2837s 2024-11-24 00:46:13,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41037 2837s 2024-11-24 00:46:13,386 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:13,386 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:13,386 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:13,386 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ow1fzqwc 2837s 2024-11-24 00:46:13,386 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:13,387 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45065. Reason: failure-to-start- 2837s 2024-11-24 00:46:13,387 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:13,387 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35423. Reason: failure-to-start- 2837s 2024-11-24 00:46:13,388 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:13,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41037': TLS handshake failed with remote 'tls://127.0.0.1:43332': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:13,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41037': TLS handshake failed with remote 'tls://127.0.0.1:43346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:13,390 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:14,394 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:14,397 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45293 2837s 2024-11-24 00:46:14,397 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37713/status 2837s 2024-11-24 00:46:14,398 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:14,405 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46193 2837s 2024-11-24 00:46:14,405 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46193 2837s 2024-11-24 00:46:14,405 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:14,405 - distributed.worker - INFO - dashboard at: 127.0.0.1:34523 2837s 2024-11-24 00:46:14,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45293 2837s 2024-11-24 00:46:14,406 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:14,406 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:14,406 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:14,406 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pia_yoz7 2837s 2024-11-24 00:46:14,406 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:14,407 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44897 2837s 2024-11-24 00:46:14,407 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44897 2837s 2024-11-24 00:46:14,407 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:14,407 - distributed.worker - INFO - dashboard at: 127.0.0.1:39169 2837s 2024-11-24 00:46:14,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45293 2837s 2024-11-24 00:46:14,407 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:14,407 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:14,408 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:14,408 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1buxrtt8 2837s 2024-11-24 00:46:14,408 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:14,409 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46193. Reason: failure-to-start- 2837s 2024-11-24 00:46:14,409 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:14,410 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44897. Reason: failure-to-start- 2837s 2024-11-24 00:46:14,410 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:14,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45293': TLS handshake failed with remote 'tls://127.0.0.1:44470': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:14,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45293': TLS handshake failed with remote 'tls://127.0.0.1:44476': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:14,412 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:15,416 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:15,420 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32847 2837s 2024-11-24 00:46:15,420 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43633/status 2837s 2024-11-24 00:46:15,420 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:15,428 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37645 2837s 2024-11-24 00:46:15,429 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37645 2837s 2024-11-24 00:46:15,429 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:15,429 - distributed.worker - INFO - dashboard at: 127.0.0.1:35325 2837s 2024-11-24 00:46:15,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32847 2837s 2024-11-24 00:46:15,429 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:15,429 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:15,429 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:15,429 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gji14oj5 2837s 2024-11-24 00:46:15,429 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:15,430 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36499 2837s 2024-11-24 00:46:15,431 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36499 2837s 2024-11-24 00:46:15,431 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:15,431 - distributed.worker - INFO - dashboard at: 127.0.0.1:39073 2837s 2024-11-24 00:46:15,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32847 2837s 2024-11-24 00:46:15,431 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:15,431 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:15,431 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:15,431 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4h5qt88b 2837s 2024-11-24 00:46:15,431 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:15,432 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37645. Reason: failure-to-start- 2837s 2024-11-24 00:46:15,432 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:15,432 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36499. Reason: failure-to-start- 2837s 2024-11-24 00:46:15,432 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:15,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32847': TLS handshake failed with remote 'tls://127.0.0.1:58744': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:15,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32847': TLS handshake failed with remote 'tls://127.0.0.1:58758': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:15,434 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:16,438 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:16,443 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44497 2837s 2024-11-24 00:46:16,444 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36727/status 2837s 2024-11-24 00:46:16,444 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:16,452 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43371 2837s 2024-11-24 00:46:16,452 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43371 2837s 2024-11-24 00:46:16,452 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:16,452 - distributed.worker - INFO - dashboard at: 127.0.0.1:41319 2837s 2024-11-24 00:46:16,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44497 2837s 2024-11-24 00:46:16,452 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:16,452 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:16,453 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:16,453 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aj5n84qt 2837s 2024-11-24 00:46:16,453 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:16,454 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37199 2837s 2024-11-24 00:46:16,454 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37199 2837s 2024-11-24 00:46:16,454 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:16,454 - distributed.worker - INFO - dashboard at: 127.0.0.1:32989 2837s 2024-11-24 00:46:16,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44497 2837s 2024-11-24 00:46:16,454 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:16,455 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:16,455 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:16,455 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xtxv027j 2837s 2024-11-24 00:46:16,455 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:16,455 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43371. Reason: failure-to-start- 2837s 2024-11-24 00:46:16,456 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:16,456 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37199. Reason: failure-to-start- 2837s 2024-11-24 00:46:16,456 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:16,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44497': TLS handshake failed with remote 'tls://127.0.0.1:39012': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:16,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44497': TLS handshake failed with remote 'tls://127.0.0.1:39018': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:16,458 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:17,462 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:17,466 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45649 2837s 2024-11-24 00:46:17,467 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34507/status 2837s 2024-11-24 00:46:17,467 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:17,477 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34473 2837s 2024-11-24 00:46:17,477 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34473 2837s 2024-11-24 00:46:17,477 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:17,477 - distributed.worker - INFO - dashboard at: 127.0.0.1:45071 2837s 2024-11-24 00:46:17,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45649 2837s 2024-11-24 00:46:17,477 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:17,477 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:17,477 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:17,477 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q6wwebpo 2837s 2024-11-24 00:46:17,477 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:17,479 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40893 2837s 2024-11-24 00:46:17,479 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40893 2837s 2024-11-24 00:46:17,479 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:17,479 - distributed.worker - INFO - dashboard at: 127.0.0.1:35247 2837s 2024-11-24 00:46:17,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45649 2837s 2024-11-24 00:46:17,479 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:17,479 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:17,479 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:17,479 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bv9o27cn 2837s 2024-11-24 00:46:17,479 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:17,480 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34473. Reason: failure-to-start- 2837s 2024-11-24 00:46:17,480 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:17,481 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40893. Reason: failure-to-start- 2837s 2024-11-24 00:46:17,481 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:17,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45649': TLS handshake failed with remote 'tls://127.0.0.1:51292': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:17,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45649': TLS handshake failed with remote 'tls://127.0.0.1:51298': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:17,483 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:18,487 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:18,491 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37307 2837s 2024-11-24 00:46:18,491 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33435/status 2837s 2024-11-24 00:46:18,491 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:18,500 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43641 2837s 2024-11-24 00:46:18,500 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43641 2837s 2024-11-24 00:46:18,501 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:18,501 - distributed.worker - INFO - dashboard at: 127.0.0.1:40519 2837s 2024-11-24 00:46:18,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37307 2837s 2024-11-24 00:46:18,501 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:18,501 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:18,501 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:18,501 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zxekegpf 2837s 2024-11-24 00:46:18,501 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:18,502 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33441 2837s 2024-11-24 00:46:18,502 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33441 2837s 2024-11-24 00:46:18,503 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:18,503 - distributed.worker - INFO - dashboard at: 127.0.0.1:43411 2837s 2024-11-24 00:46:18,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37307 2837s 2024-11-24 00:46:18,503 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:18,503 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:18,503 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:18,503 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b73nofjh 2837s 2024-11-24 00:46:18,503 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:18,504 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43641. Reason: failure-to-start- 2837s 2024-11-24 00:46:18,504 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:18,504 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33441. Reason: failure-to-start- 2837s 2024-11-24 00:46:18,504 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:18,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37307': TLS handshake failed with remote 'tls://127.0.0.1:46752': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:18,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37307': TLS handshake failed with remote 'tls://127.0.0.1:46756': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:18,506 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:19,511 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:19,514 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43107 2837s 2024-11-24 00:46:19,515 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39983/status 2837s 2024-11-24 00:46:19,515 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:19,523 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35525 2837s 2024-11-24 00:46:19,524 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35525 2837s 2024-11-24 00:46:19,524 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:19,524 - distributed.worker - INFO - dashboard at: 127.0.0.1:35795 2837s 2024-11-24 00:46:19,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43107 2837s 2024-11-24 00:46:19,524 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:19,524 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:19,524 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:19,524 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-58o1zhmt 2837s 2024-11-24 00:46:19,524 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:19,526 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35895 2837s 2024-11-24 00:46:19,526 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35895 2837s 2024-11-24 00:46:19,526 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:19,526 - distributed.worker - INFO - dashboard at: 127.0.0.1:38405 2837s 2024-11-24 00:46:19,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43107 2837s 2024-11-24 00:46:19,526 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:19,526 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:19,526 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:19,526 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bpwp5n4t 2837s 2024-11-24 00:46:19,526 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:19,528 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35525. Reason: failure-to-start- 2837s 2024-11-24 00:46:19,528 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:19,528 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35895. Reason: failure-to-start- 2837s 2024-11-24 00:46:19,528 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:19,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43107': TLS handshake failed with remote 'tls://127.0.0.1:51514': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:19,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43107': TLS handshake failed with remote 'tls://127.0.0.1:51522': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:19,530 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:20,535 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:20,539 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34877 2837s 2024-11-24 00:46:20,539 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41313/status 2837s 2024-11-24 00:46:20,540 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:20,549 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45975 2837s 2024-11-24 00:46:20,549 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45975 2837s 2024-11-24 00:46:20,549 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:20,549 - distributed.worker - INFO - dashboard at: 127.0.0.1:39795 2837s 2024-11-24 00:46:20,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34877 2837s 2024-11-24 00:46:20,549 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:20,549 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:20,549 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:20,549 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v_r5tka0 2837s 2024-11-24 00:46:20,549 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:20,551 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35419 2837s 2024-11-24 00:46:20,551 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35419 2837s 2024-11-24 00:46:20,551 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:20,551 - distributed.worker - INFO - dashboard at: 127.0.0.1:34043 2837s 2024-11-24 00:46:20,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34877 2837s 2024-11-24 00:46:20,551 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:20,551 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:20,551 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:20,551 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7j0l_eov 2837s 2024-11-24 00:46:20,551 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:20,553 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45975. Reason: failure-to-start- 2837s 2024-11-24 00:46:20,553 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:20,553 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35419. Reason: failure-to-start- 2837s 2024-11-24 00:46:20,554 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:20,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34877': TLS handshake failed with remote 'tls://127.0.0.1:46328': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:20,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34877': TLS handshake failed with remote 'tls://127.0.0.1:46334': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:20,556 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:21,561 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:21,565 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44371 2837s 2024-11-24 00:46:21,565 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33219/status 2837s 2024-11-24 00:46:21,566 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:21,575 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45439 2837s 2024-11-24 00:46:21,575 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45439 2837s 2024-11-24 00:46:21,576 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:21,576 - distributed.worker - INFO - dashboard at: 127.0.0.1:45833 2837s 2024-11-24 00:46:21,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44371 2837s 2024-11-24 00:46:21,576 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:21,576 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:21,576 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:21,576 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d6wtuz2x 2837s 2024-11-24 00:46:21,576 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:21,577 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38537 2837s 2024-11-24 00:46:21,578 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38537 2837s 2024-11-24 00:46:21,578 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:21,578 - distributed.worker - INFO - dashboard at: 127.0.0.1:35581 2837s 2024-11-24 00:46:21,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44371 2837s 2024-11-24 00:46:21,578 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:21,578 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:21,578 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:21,578 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-su83goks 2837s 2024-11-24 00:46:21,578 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:21,579 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45439. Reason: failure-to-start- 2837s 2024-11-24 00:46:21,579 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:21,579 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38537. Reason: failure-to-start- 2837s 2024-11-24 00:46:21,579 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:21,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44371': TLS handshake failed with remote 'tls://127.0.0.1:48896': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:21,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44371': TLS handshake failed with remote 'tls://127.0.0.1:48900': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:21,581 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:22,586 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:22,590 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36795 2837s 2024-11-24 00:46:22,590 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45085/status 2837s 2024-11-24 00:46:22,591 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:22,601 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33713 2837s 2024-11-24 00:46:22,601 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33713 2837s 2024-11-24 00:46:22,601 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:22,601 - distributed.worker - INFO - dashboard at: 127.0.0.1:39351 2837s 2024-11-24 00:46:22,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36795 2837s 2024-11-24 00:46:22,601 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:22,601 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:22,602 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:22,602 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qvyetknh 2837s 2024-11-24 00:46:22,602 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:22,603 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43775 2837s 2024-11-24 00:46:22,603 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43775 2837s 2024-11-24 00:46:22,603 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:22,603 - distributed.worker - INFO - dashboard at: 127.0.0.1:37481 2837s 2024-11-24 00:46:22,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36795 2837s 2024-11-24 00:46:22,604 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:22,604 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:22,604 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:22,604 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d40tsa5c 2837s 2024-11-24 00:46:22,604 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:22,605 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33713. Reason: failure-to-start- 2837s 2024-11-24 00:46:22,605 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:22,605 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43775. Reason: failure-to-start- 2837s 2024-11-24 00:46:22,605 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:22,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36795': TLS handshake failed with remote 'tls://127.0.0.1:51248': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:22,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36795': TLS handshake failed with remote 'tls://127.0.0.1:51262': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:22,608 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:23,613 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:23,617 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37237 2837s 2024-11-24 00:46:23,618 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35509/status 2837s 2024-11-24 00:46:23,618 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:23,628 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36467 2837s 2024-11-24 00:46:23,628 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36467 2837s 2024-11-24 00:46:23,628 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:23,628 - distributed.worker - INFO - dashboard at: 127.0.0.1:42301 2837s 2024-11-24 00:46:23,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37237 2837s 2024-11-24 00:46:23,628 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:23,628 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:23,628 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:23,628 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yh_qvqin 2837s 2024-11-24 00:46:23,628 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:23,630 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32921 2837s 2024-11-24 00:46:23,630 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32921 2837s 2024-11-24 00:46:23,630 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:23,630 - distributed.worker - INFO - dashboard at: 127.0.0.1:41055 2837s 2024-11-24 00:46:23,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37237 2837s 2024-11-24 00:46:23,630 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:23,630 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:23,630 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:23,630 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lwnc79nr 2837s 2024-11-24 00:46:23,630 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:23,631 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36467. Reason: failure-to-start- 2837s 2024-11-24 00:46:23,632 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:23,632 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32921. Reason: failure-to-start- 2837s 2024-11-24 00:46:23,632 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:23,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37237': TLS handshake failed with remote 'tls://127.0.0.1:55898': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:23,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37237': TLS handshake failed with remote 'tls://127.0.0.1:55902': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:23,635 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:24,640 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:24,644 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44953 2837s 2024-11-24 00:46:24,644 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35491/status 2837s 2024-11-24 00:46:24,644 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:24,653 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45381 2837s 2024-11-24 00:46:24,653 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45381 2837s 2024-11-24 00:46:24,653 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:24,654 - distributed.worker - INFO - dashboard at: 127.0.0.1:39129 2837s 2024-11-24 00:46:24,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44953 2837s 2024-11-24 00:46:24,654 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:24,654 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:24,654 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:24,654 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hr646s1y 2837s 2024-11-24 00:46:24,654 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:24,655 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36333 2837s 2024-11-24 00:46:24,656 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36333 2837s 2024-11-24 00:46:24,656 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:24,656 - distributed.worker - INFO - dashboard at: 127.0.0.1:42355 2837s 2024-11-24 00:46:24,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44953 2837s 2024-11-24 00:46:24,668 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:24,668 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:24,668 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:24,668 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9nlzsib2 2837s 2024-11-24 00:46:24,668 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:24,669 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45381. Reason: failure-to-start- 2837s 2024-11-24 00:46:24,669 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:24,669 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36333. Reason: failure-to-start- 2837s 2024-11-24 00:46:24,670 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:24,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44953': TLS handshake failed with remote 'tls://127.0.0.1:58124': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:24,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44953': TLS handshake failed with remote 'tls://127.0.0.1:58126': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:24,673 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:25,677 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:25,681 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41869 2837s 2024-11-24 00:46:25,681 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41239/status 2837s 2024-11-24 00:46:25,682 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:25,692 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38035 2837s 2024-11-24 00:46:25,692 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38035 2837s 2024-11-24 00:46:25,692 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:25,692 - distributed.worker - INFO - dashboard at: 127.0.0.1:37427 2837s 2024-11-24 00:46:25,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41869 2837s 2024-11-24 00:46:25,692 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:25,692 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:25,692 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:25,692 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kzmq0gs2 2837s 2024-11-24 00:46:25,692 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:25,694 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43121 2837s 2024-11-24 00:46:25,694 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43121 2837s 2024-11-24 00:46:25,694 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:25,694 - distributed.worker - INFO - dashboard at: 127.0.0.1:39529 2837s 2024-11-24 00:46:25,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41869 2837s 2024-11-24 00:46:25,694 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:25,694 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:25,694 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:25,694 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7qsm6c3x 2837s 2024-11-24 00:46:25,694 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:25,695 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38035. Reason: failure-to-start- 2837s 2024-11-24 00:46:25,695 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:25,696 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43121. Reason: failure-to-start- 2837s 2024-11-24 00:46:25,696 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:25,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41869': TLS handshake failed with remote 'tls://127.0.0.1:43910': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:25,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41869': TLS handshake failed with remote 'tls://127.0.0.1:43916': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:25,698 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:26,703 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:26,708 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38267 2837s 2024-11-24 00:46:26,708 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35645/status 2837s 2024-11-24 00:46:26,708 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:26,718 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41065 2837s 2024-11-24 00:46:26,718 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41065 2837s 2024-11-24 00:46:26,718 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:26,718 - distributed.worker - INFO - dashboard at: 127.0.0.1:43117 2837s 2024-11-24 00:46:26,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38267 2837s 2024-11-24 00:46:26,718 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:26,718 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:26,718 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:26,718 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-prynxce7 2837s 2024-11-24 00:46:26,718 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:26,720 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42583 2837s 2024-11-24 00:46:26,720 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42583 2837s 2024-11-24 00:46:26,720 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:26,720 - distributed.worker - INFO - dashboard at: 127.0.0.1:46023 2837s 2024-11-24 00:46:26,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38267 2837s 2024-11-24 00:46:26,720 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:26,720 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:26,720 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:26,720 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hamxn9q9 2837s 2024-11-24 00:46:26,720 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:26,721 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41065. Reason: failure-to-start- 2837s 2024-11-24 00:46:26,721 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:26,722 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42583. Reason: failure-to-start- 2837s 2024-11-24 00:46:26,722 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:26,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38267': TLS handshake failed with remote 'tls://127.0.0.1:50558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:26,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38267': TLS handshake failed with remote 'tls://127.0.0.1:50566': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:26,724 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:46:27,728 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:27,732 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45091 2837s 2024-11-24 00:46:27,732 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32783/status 2837s 2024-11-24 00:46:27,732 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:27,743 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44083 2837s 2024-11-24 00:46:27,743 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44083 2837s 2024-11-24 00:46:27,743 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:27,743 - distributed.worker - INFO - dashboard at: 127.0.0.1:35789 2837s 2024-11-24 00:46:27,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45091 2837s 2024-11-24 00:46:27,743 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:27,743 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:27,743 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:27,743 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zy185bzb 2837s 2024-11-24 00:46:27,743 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:27,745 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45781 2837s 2024-11-24 00:46:27,745 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45781 2837s 2024-11-24 00:46:27,745 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:27,745 - distributed.worker - INFO - dashboard at: 127.0.0.1:42159 2837s 2024-11-24 00:46:27,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45091 2837s 2024-11-24 00:46:27,745 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:27,745 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:27,745 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:27,745 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-77engb09 2837s 2024-11-24 00:46:27,745 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:27,746 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44083. Reason: failure-to-start- 2837s 2024-11-24 00:46:27,746 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:27,747 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45781. Reason: failure-to-start- 2837s 2024-11-24 00:46:27,747 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:27,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45091': TLS handshake failed with remote 'tls://127.0.0.1:57318': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:27,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45091': TLS handshake failed with remote 'tls://127.0.0.1:57320': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:27,749 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s _________________________________ test_gather __________________________________ 2837s 2837s fut = , timeout = 0 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 2837s await self._register_with_scheduler() 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2837s comm = await wait_for( 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2837s return await fut 2837s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 2837s stream = await self.client.connect( 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s host = '127.0.0.1', port = 36083, af = 2837s ssl_options = 2837s max_buffer_size = 4151066624.0, source_ip = None, source_port = None 2837s timeout = None 2837s 2837s async def connect( 2837s self, 2837s host: str, 2837s port: int, 2837s af: socket.AddressFamily = socket.AF_UNSPEC, 2837s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 2837s max_buffer_size: Optional[int] = None, 2837s source_ip: Optional[str] = None, 2837s source_port: Optional[int] = None, 2837s timeout: Optional[Union[float, datetime.timedelta]] = None, 2837s ) -> IOStream: 2837s """Connect to the given host and port. 2837s 2837s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 2837s ``ssl_options`` is not None). 2837s 2837s Using the ``source_ip`` kwarg, one can specify the source 2837s IP address to use when establishing the connection. 2837s In case the user needs to resolve and 2837s use a specific interface, it has to be handled outside 2837s of Tornado as this depends very much on the platform. 2837s 2837s Raises `TimeoutError` if the input future does not complete before 2837s ``timeout``, which may be specified in any form allowed by 2837s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 2837s relative to `.IOLoop.time`) 2837s 2837s Similarly, when the user requires a certain source port, it can 2837s be specified using the ``source_port`` arg. 2837s 2837s .. versionchanged:: 4.5 2837s Added the ``source_ip`` and ``source_port`` arguments. 2837s 2837s .. versionchanged:: 5.0 2837s Added the ``timeout`` argument. 2837s """ 2837s if timeout is not None: 2837s if isinstance(timeout, numbers.Real): 2837s timeout = IOLoop.current().time() + timeout 2837s elif isinstance(timeout, datetime.timedelta): 2837s timeout = IOLoop.current().time() + timeout.total_seconds() 2837s else: 2837s raise TypeError("Unsupported timeout %r" % timeout) 2837s if timeout is not None: 2837s addrinfo = await gen.with_timeout( 2837s timeout, self.resolver.resolve(host, port, af) 2837s ) 2837s else: 2837s addrinfo = await self.resolver.resolve(host, port, af) 2837s connector = _Connector( 2837s addrinfo, 2837s functools.partial( 2837s self._create_stream, 2837s max_buffer_size, 2837s source_ip=source_ip, 2837s source_port=source_port, 2837s ), 2837s ) 2837s > af, addr, stream = await connector.start(connect_timeout=timeout) 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s > await wait_for(self.start_unsafe(), timeout=timeout) 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:664: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s @contextlib.asynccontextmanager 2837s async def _cluster_factory(): 2837s workers = [] 2837s s = None 2837s try: 2837s for _ in range(60): 2837s try: 2837s > s, ws = await start_cluster( 2837s nthreads, 2837s scheduler, 2837s security=security, 2837s Worker=Worker, 2837s scheduler_kwargs=scheduler_kwargs, 2837s worker_kwargs=merge( 2837s {"death_timeout": min(15, int(deadline.remaining))}, 2837s worker_kwargs, 2837s ), 2837s ) 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 2837s await asyncio.gather(*workers) 2837s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 2837s return await awaitable 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s except asyncio.TimeoutError as exc: 2837s await _close_on_failure(exc) 2837s > raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s E TimeoutError: Worker start timed out after 0s. 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s fut = ._..test_func..async_fn at 0xe63f7717ad90> 2837s timeout = 60 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 2837s _cluster_factory() as (s, workers), 2837s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 2837s return await anext(self.gen) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 2837s await asyncio.sleep(1) 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s delay = 1, result = None 2837s 2837s async def sleep(delay, result=None): 2837s """Coroutine that completes after a given time (in seconds).""" 2837s if delay <= 0: 2837s await __sleep0() 2837s return result 2837s 2837s if math.isnan(delay): 2837s raise ValueError("Invalid delay: NaN (not a number)") 2837s 2837s loop = events.get_running_loop() 2837s future = loop.create_future() 2837s h = loop.call_later(delay, 2837s futures._set_result_unless_cancelled, 2837s future, result) 2837s try: 2837s > return await future 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s args = (), kwds = {} 2837s 2837s @wraps(func) 2837s def inner(*args, **kwds): 2837s with self._recreate_cm(): 2837s > return func(*args, **kwds) 2837s 2837s /usr/lib/python3.13/contextlib.py:85: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3.13/contextlib.py:85: in inner 2837s return func(*args, **kwds) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 2837s return _run_and_close_tornado(async_fn_outer) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 2837s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 2837s /usr/lib/python3.13/asyncio/runners.py:194: in run 2837s return runner.run(main) 2837s /usr/lib/python3.13/asyncio/runners.py:118: in run 2837s return self._loop.run_until_complete(task) 2837s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 2837s return future.result() 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 2837s return await async_fn(*args, **kwargs) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 2837s return await utils_wait_for(async_fn(), timeout=timeout * 2) 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s ----------------------------- Captured stderr call ----------------------------- 2837s 2024-11-24 00:46:29,054 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:29,058 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,058 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37833/status 2837s 2024-11-24 00:46:29,058 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:29,067 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40591 2837s 2024-11-24 00:46:29,067 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40591 2837s 2024-11-24 00:46:29,067 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:29,067 - distributed.worker - INFO - dashboard at: 127.0.0.1:38879 2837s 2024-11-24 00:46:29,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,067 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:29,067 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:29,067 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:29,067 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w07vkewz 2837s 2024-11-24 00:46:29,067 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:29,069 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41215 2837s 2024-11-24 00:46:29,069 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41215 2837s 2024-11-24 00:46:29,069 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:29,069 - distributed.worker - INFO - dashboard at: 127.0.0.1:33243 2837s 2024-11-24 00:46:29,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,069 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:29,069 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:29,069 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:29,069 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k_3cogpf 2837s 2024-11-24 00:46:29,069 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:29,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:29,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:29,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:29,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:29,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:29,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:29,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:29,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:29,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:29,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:29,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:29,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:29,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:29,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:29,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:29,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:29,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:29,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:29,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:30,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:30,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:31,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:31,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:32,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:32,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:33,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:33,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:34,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:34,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:38164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:35,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:35,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:36,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:36,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:37,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:37,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:36998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:38,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:38,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:39,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:39,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:40,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:40,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:41,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:41,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:42,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:42,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:43,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:43,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:44,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:44,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:44,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 2837s 2024-11-24 00:46:44,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:37946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:44,066 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40591. Reason: failure-to-start- 2837s 2024-11-24 00:46:44,066 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:44,067 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 15s. 2837s 2024-11-24 00:46:44,070 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41215. Reason: failure-to-start- 2837s 2024-11-24 00:46:44,070 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:45,073 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:45,078 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,078 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46539/status 2837s 2024-11-24 00:46:45,078 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:45,086 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36229 2837s 2024-11-24 00:46:45,086 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36229 2837s 2024-11-24 00:46:45,086 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:45,086 - distributed.worker - INFO - dashboard at: 127.0.0.1:45127 2837s 2024-11-24 00:46:45,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,086 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:45,086 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:45,086 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:45,086 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a4maalwm 2837s 2024-11-24 00:46:45,087 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:45,088 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44311 2837s 2024-11-24 00:46:45,088 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44311 2837s 2024-11-24 00:46:45,088 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:45,088 - distributed.worker - INFO - dashboard at: 127.0.0.1:38201 2837s 2024-11-24 00:46:45,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,088 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:45,088 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:45,088 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:45,088 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4bjtcfm_ 2837s 2024-11-24 00:46:45,088 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:45,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:54722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:45,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:54724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:45,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:54732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:45,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:54740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:45,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:45,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:45,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:45,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:45,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:45,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:45,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:45,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:45,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:45,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:45,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:45,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:45,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:45,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:45,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:50998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:46,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:46,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:47,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:47,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:48,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:48,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:49,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:49,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:49,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:49,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:49,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:49,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:49,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:49,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:49,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:49,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:49,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:49,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:49,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:49,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:49,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:49,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:49,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:49,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:49,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:49,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:49,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:49,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:49,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:49,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:49,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:49,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:49,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:49,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:49,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:49,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:49,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:49,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:50,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:50,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:51,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:51,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:51984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:52,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:52,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:53,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:53,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:54,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:54,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:52422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:55,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:55,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:56,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:56,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:57,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:57,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:58,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:58,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:58,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40289 2837s 2024-11-24 00:46:58,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:33596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:46:58,085 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36229. Reason: failure-to-start- 2837s 2024-11-24 00:46:58,085 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:58,086 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 13s. 2837s 2024-11-24 00:46:58,090 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44311. Reason: failure-to-start- 2837s 2024-11-24 00:46:58,090 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:59,092 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:46:59,096 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42245 2837s 2024-11-24 00:46:59,096 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41959/status 2837s 2024-11-24 00:46:59,096 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:46:59,105 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44157 2837s 2024-11-24 00:46:59,105 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44157 2837s 2024-11-24 00:46:59,105 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:46:59,105 - distributed.worker - INFO - dashboard at: 127.0.0.1:39889 2837s 2024-11-24 00:46:59,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42245 2837s 2024-11-24 00:46:59,105 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:59,105 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:46:59,105 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:59,105 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hb64tvop 2837s 2024-11-24 00:46:59,105 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:59,107 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36669 2837s 2024-11-24 00:46:59,107 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36669 2837s 2024-11-24 00:46:59,107 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:46:59,107 - distributed.worker - INFO - dashboard at: 127.0.0.1:38611 2837s 2024-11-24 00:46:59,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42245 2837s 2024-11-24 00:46:59,107 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:59,107 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:46:59,107 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:46:59,107 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-if26g_at 2837s 2024-11-24 00:46:59,107 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:46:59,108 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44157. Reason: failure-to-start- 2837s 2024-11-24 00:46:59,108 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:59,108 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36669. Reason: failure-to-start- 2837s 2024-11-24 00:46:59,108 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:46:59,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42245': TLS handshake failed with remote 'tls://127.0.0.1:33602': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:59,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42245': TLS handshake failed with remote 'tls://127.0.0.1:33614': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:46:59,110 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:00,115 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:00,119 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36753 2837s 2024-11-24 00:47:00,119 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44833/status 2837s 2024-11-24 00:47:00,119 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:00,127 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36417 2837s 2024-11-24 00:47:00,128 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36417 2837s 2024-11-24 00:47:00,128 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:00,128 - distributed.worker - INFO - dashboard at: 127.0.0.1:35005 2837s 2024-11-24 00:47:00,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36753 2837s 2024-11-24 00:47:00,128 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:00,128 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:00,128 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:00,128 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y4d9zxgo 2837s 2024-11-24 00:47:00,128 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:00,129 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34051 2837s 2024-11-24 00:47:00,130 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34051 2837s 2024-11-24 00:47:00,130 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:00,130 - distributed.worker - INFO - dashboard at: 127.0.0.1:44683 2837s 2024-11-24 00:47:00,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36753 2837s 2024-11-24 00:47:00,130 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:00,130 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:00,130 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:00,130 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yxquvoqn 2837s 2024-11-24 00:47:00,130 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:00,131 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36417. Reason: failure-to-start- 2837s 2024-11-24 00:47:00,131 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:00,131 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34051. Reason: failure-to-start- 2837s 2024-11-24 00:47:00,131 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:00,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36753': TLS handshake failed with remote 'tls://127.0.0.1:46840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:00,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36753': TLS handshake failed with remote 'tls://127.0.0.1:46852': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:00,133 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:01,138 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:01,142 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37691 2837s 2024-11-24 00:47:01,142 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41365/status 2837s 2024-11-24 00:47:01,142 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:01,150 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35235 2837s 2024-11-24 00:47:01,150 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35235 2837s 2024-11-24 00:47:01,150 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:01,150 - distributed.worker - INFO - dashboard at: 127.0.0.1:46053 2837s 2024-11-24 00:47:01,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37691 2837s 2024-11-24 00:47:01,150 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:01,150 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:01,150 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:01,150 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xkpoqjpe 2837s 2024-11-24 00:47:01,150 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:01,152 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44203 2837s 2024-11-24 00:47:01,152 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44203 2837s 2024-11-24 00:47:01,152 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:01,152 - distributed.worker - INFO - dashboard at: 127.0.0.1:43453 2837s 2024-11-24 00:47:01,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37691 2837s 2024-11-24 00:47:01,152 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:01,152 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:01,152 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:01,152 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mpoajcik 2837s 2024-11-24 00:47:01,152 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:01,153 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35235. Reason: failure-to-start- 2837s 2024-11-24 00:47:01,153 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:01,153 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44203. Reason: failure-to-start- 2837s 2024-11-24 00:47:01,153 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:01,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37691': TLS handshake failed with remote 'tls://127.0.0.1:50492': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:01,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37691': TLS handshake failed with remote 'tls://127.0.0.1:50502': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:01,155 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:02,160 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:02,163 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38905 2837s 2024-11-24 00:47:02,164 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37369/status 2837s 2024-11-24 00:47:02,164 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:02,173 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36861 2837s 2024-11-24 00:47:02,173 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36861 2837s 2024-11-24 00:47:02,173 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:02,173 - distributed.worker - INFO - dashboard at: 127.0.0.1:39069 2837s 2024-11-24 00:47:02,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38905 2837s 2024-11-24 00:47:02,173 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:02,173 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:02,173 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:02,173 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gj4p1oy6 2837s 2024-11-24 00:47:02,173 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:02,175 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44187 2837s 2024-11-24 00:47:02,175 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44187 2837s 2024-11-24 00:47:02,175 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:02,175 - distributed.worker - INFO - dashboard at: 127.0.0.1:32967 2837s 2024-11-24 00:47:02,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38905 2837s 2024-11-24 00:47:02,175 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:02,175 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:02,175 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:02,175 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gdu2618c 2837s 2024-11-24 00:47:02,175 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:02,176 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36861. Reason: failure-to-start- 2837s 2024-11-24 00:47:02,176 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:02,176 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44187. Reason: failure-to-start- 2837s 2024-11-24 00:47:02,176 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:02,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38905': TLS handshake failed with remote 'tls://127.0.0.1:36486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:02,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38905': TLS handshake failed with remote 'tls://127.0.0.1:36500': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:02,178 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:03,182 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:03,186 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32977 2837s 2024-11-24 00:47:03,186 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45087/status 2837s 2024-11-24 00:47:03,187 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:03,196 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42019 2837s 2024-11-24 00:47:03,196 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42019 2837s 2024-11-24 00:47:03,196 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:03,196 - distributed.worker - INFO - dashboard at: 127.0.0.1:36607 2837s 2024-11-24 00:47:03,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32977 2837s 2024-11-24 00:47:03,196 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:03,196 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:03,196 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:03,196 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t6nqltd8 2837s 2024-11-24 00:47:03,196 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:03,198 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45607 2837s 2024-11-24 00:47:03,198 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45607 2837s 2024-11-24 00:47:03,198 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:03,198 - distributed.worker - INFO - dashboard at: 127.0.0.1:43113 2837s 2024-11-24 00:47:03,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32977 2837s 2024-11-24 00:47:03,198 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:03,198 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:03,198 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:03,198 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-czy5yfz8 2837s 2024-11-24 00:47:03,198 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:03,199 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42019. Reason: failure-to-start- 2837s 2024-11-24 00:47:03,199 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:03,199 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45607. Reason: failure-to-start- 2837s 2024-11-24 00:47:03,199 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:03,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32977': TLS handshake failed with remote 'tls://127.0.0.1:57870': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:03,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32977': TLS handshake failed with remote 'tls://127.0.0.1:57878': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:03,201 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:04,206 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:04,211 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41901 2837s 2024-11-24 00:47:04,211 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34261/status 2837s 2024-11-24 00:47:04,211 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:04,219 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42963 2837s 2024-11-24 00:47:04,220 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42963 2837s 2024-11-24 00:47:04,220 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:04,220 - distributed.worker - INFO - dashboard at: 127.0.0.1:41219 2837s 2024-11-24 00:47:04,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41901 2837s 2024-11-24 00:47:04,220 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:04,220 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:04,220 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:04,220 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2z_xomm_ 2837s 2024-11-24 00:47:04,220 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:04,221 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45017 2837s 2024-11-24 00:47:04,221 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45017 2837s 2024-11-24 00:47:04,222 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:04,222 - distributed.worker - INFO - dashboard at: 127.0.0.1:44885 2837s 2024-11-24 00:47:04,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41901 2837s 2024-11-24 00:47:04,222 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:04,222 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:04,222 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:04,222 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pc2_sujt 2837s 2024-11-24 00:47:04,222 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:04,223 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42963. Reason: failure-to-start- 2837s 2024-11-24 00:47:04,223 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:04,223 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45017. Reason: failure-to-start- 2837s 2024-11-24 00:47:04,223 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:04,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41901': TLS handshake failed with remote 'tls://127.0.0.1:50940': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:04,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41901': TLS handshake failed with remote 'tls://127.0.0.1:50948': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:04,225 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:05,234 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:05,238 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41605 2837s 2024-11-24 00:47:05,238 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43559/status 2837s 2024-11-24 00:47:05,239 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:05,246 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41409 2837s 2024-11-24 00:47:05,246 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41409 2837s 2024-11-24 00:47:05,246 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:05,246 - distributed.worker - INFO - dashboard at: 127.0.0.1:38457 2837s 2024-11-24 00:47:05,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41605 2837s 2024-11-24 00:47:05,247 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:05,247 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:05,247 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:05,247 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hf3f6owr 2837s 2024-11-24 00:47:05,247 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:05,248 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41921 2837s 2024-11-24 00:47:05,248 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41921 2837s 2024-11-24 00:47:05,248 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:05,248 - distributed.worker - INFO - dashboard at: 127.0.0.1:46141 2837s 2024-11-24 00:47:05,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41605 2837s 2024-11-24 00:47:05,248 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:05,248 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:05,248 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:05,248 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ofqbq98m 2837s 2024-11-24 00:47:05,249 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:05,249 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41409. Reason: failure-to-start- 2837s 2024-11-24 00:47:05,249 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:05,250 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41921. Reason: failure-to-start- 2837s 2024-11-24 00:47:05,250 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:05,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41605': TLS handshake failed with remote 'tls://127.0.0.1:38092': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:05,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41605': TLS handshake failed with remote 'tls://127.0.0.1:38102': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:05,252 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:06,256 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:06,260 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46599 2837s 2024-11-24 00:47:06,260 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42701/status 2837s 2024-11-24 00:47:06,260 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:06,270 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44949 2837s 2024-11-24 00:47:06,270 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44949 2837s 2024-11-24 00:47:06,270 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:06,270 - distributed.worker - INFO - dashboard at: 127.0.0.1:35201 2837s 2024-11-24 00:47:06,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46599 2837s 2024-11-24 00:47:06,270 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:06,270 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:06,270 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:06,270 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-omtlm6t_ 2837s 2024-11-24 00:47:06,270 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:06,271 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33697 2837s 2024-11-24 00:47:06,271 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33697 2837s 2024-11-24 00:47:06,272 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:06,272 - distributed.worker - INFO - dashboard at: 127.0.0.1:35383 2837s 2024-11-24 00:47:06,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46599 2837s 2024-11-24 00:47:06,272 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:06,272 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:06,272 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:06,272 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r1u35o_a 2837s 2024-11-24 00:47:06,272 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:06,273 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44949. Reason: failure-to-start- 2837s 2024-11-24 00:47:06,273 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:06,273 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33697. Reason: failure-to-start- 2837s 2024-11-24 00:47:06,273 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:06,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46599': TLS handshake failed with remote 'tls://127.0.0.1:43274': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:06,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46599': TLS handshake failed with remote 'tls://127.0.0.1:43290': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:06,275 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:07,281 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:07,284 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42621 2837s 2024-11-24 00:47:07,285 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39585/status 2837s 2024-11-24 00:47:07,285 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:07,293 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33113 2837s 2024-11-24 00:47:07,293 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33113 2837s 2024-11-24 00:47:07,293 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:07,293 - distributed.worker - INFO - dashboard at: 127.0.0.1:34023 2837s 2024-11-24 00:47:07,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42621 2837s 2024-11-24 00:47:07,293 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:07,293 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:07,293 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:07,293 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zhd_374g 2837s 2024-11-24 00:47:07,293 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:07,295 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39583 2837s 2024-11-24 00:47:07,295 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39583 2837s 2024-11-24 00:47:07,295 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:07,295 - distributed.worker - INFO - dashboard at: 127.0.0.1:33059 2837s 2024-11-24 00:47:07,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42621 2837s 2024-11-24 00:47:07,296 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:07,296 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:07,296 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:07,296 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9i72u24z 2837s 2024-11-24 00:47:07,296 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:07,296 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33113. Reason: failure-to-start- 2837s 2024-11-24 00:47:07,297 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:07,297 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39583. Reason: failure-to-start- 2837s 2024-11-24 00:47:07,297 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:07,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42621': TLS handshake failed with remote 'tls://127.0.0.1:56152': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:07,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42621': TLS handshake failed with remote 'tls://127.0.0.1:56164': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:07,299 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:08,303 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:08,307 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38891 2837s 2024-11-24 00:47:08,307 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45117/status 2837s 2024-11-24 00:47:08,307 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:08,315 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39971 2837s 2024-11-24 00:47:08,315 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39971 2837s 2024-11-24 00:47:08,315 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:08,315 - distributed.worker - INFO - dashboard at: 127.0.0.1:41379 2837s 2024-11-24 00:47:08,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38891 2837s 2024-11-24 00:47:08,315 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:08,315 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:08,315 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:08,315 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rumvpq22 2837s 2024-11-24 00:47:08,315 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:08,317 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45017 2837s 2024-11-24 00:47:08,317 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45017 2837s 2024-11-24 00:47:08,317 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:08,317 - distributed.worker - INFO - dashboard at: 127.0.0.1:42103 2837s 2024-11-24 00:47:08,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38891 2837s 2024-11-24 00:47:08,317 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:08,317 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:08,317 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:08,317 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yyq3k3si 2837s 2024-11-24 00:47:08,317 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:08,318 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39971. Reason: failure-to-start- 2837s 2024-11-24 00:47:08,318 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:08,318 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45017. Reason: failure-to-start- 2837s 2024-11-24 00:47:08,318 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:08,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38891': TLS handshake failed with remote 'tls://127.0.0.1:47438': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:08,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38891': TLS handshake failed with remote 'tls://127.0.0.1:47452': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:08,320 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:09,326 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:09,330 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41409 2837s 2024-11-24 00:47:09,330 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46721/status 2837s 2024-11-24 00:47:09,330 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:09,338 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33581 2837s 2024-11-24 00:47:09,338 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33581 2837s 2024-11-24 00:47:09,338 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:09,338 - distributed.worker - INFO - dashboard at: 127.0.0.1:38429 2837s 2024-11-24 00:47:09,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41409 2837s 2024-11-24 00:47:09,338 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:09,338 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:09,338 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:09,338 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-55xziafq 2837s 2024-11-24 00:47:09,338 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:09,340 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35273 2837s 2024-11-24 00:47:09,340 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35273 2837s 2024-11-24 00:47:09,340 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:09,340 - distributed.worker - INFO - dashboard at: 127.0.0.1:38223 2837s 2024-11-24 00:47:09,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41409 2837s 2024-11-24 00:47:09,340 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:09,340 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:09,340 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:09,340 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i59osy47 2837s 2024-11-24 00:47:09,340 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:09,341 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33581. Reason: failure-to-start- 2837s 2024-11-24 00:47:09,341 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:09,341 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35273. Reason: failure-to-start- 2837s 2024-11-24 00:47:09,341 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:09,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41409': TLS handshake failed with remote 'tls://127.0.0.1:38476': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:09,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41409': TLS handshake failed with remote 'tls://127.0.0.1:38488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:09,343 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:10,348 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:10,352 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46347 2837s 2024-11-24 00:47:10,352 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36631/status 2837s 2024-11-24 00:47:10,352 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:10,361 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38919 2837s 2024-11-24 00:47:10,361 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38919 2837s 2024-11-24 00:47:10,361 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:10,361 - distributed.worker - INFO - dashboard at: 127.0.0.1:34981 2837s 2024-11-24 00:47:10,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46347 2837s 2024-11-24 00:47:10,362 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:10,362 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:10,362 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:10,362 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-esoqachp 2837s 2024-11-24 00:47:10,362 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:10,363 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33973 2837s 2024-11-24 00:47:10,363 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33973 2837s 2024-11-24 00:47:10,363 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:10,363 - distributed.worker - INFO - dashboard at: 127.0.0.1:37991 2837s 2024-11-24 00:47:10,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46347 2837s 2024-11-24 00:47:10,363 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:10,363 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:10,363 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:10,363 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qzf6ssfp 2837s 2024-11-24 00:47:10,364 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:10,364 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38919. Reason: failure-to-start- 2837s 2024-11-24 00:47:10,364 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:10,365 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33973. Reason: failure-to-start- 2837s 2024-11-24 00:47:10,365 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:10,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46347': TLS handshake failed with remote 'tls://127.0.0.1:52974': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:10,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46347': TLS handshake failed with remote 'tls://127.0.0.1:52978': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:10,366 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:11,371 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:11,375 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43135 2837s 2024-11-24 00:47:11,376 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33183/status 2837s 2024-11-24 00:47:11,376 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:11,384 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32787 2837s 2024-11-24 00:47:11,385 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32787 2837s 2024-11-24 00:47:11,385 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:11,385 - distributed.worker - INFO - dashboard at: 127.0.0.1:44531 2837s 2024-11-24 00:47:11,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43135 2837s 2024-11-24 00:47:11,385 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:11,385 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:11,385 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:11,385 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xznkqw3u 2837s 2024-11-24 00:47:11,385 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:11,386 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38523 2837s 2024-11-24 00:47:11,386 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38523 2837s 2024-11-24 00:47:11,386 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:11,387 - distributed.worker - INFO - dashboard at: 127.0.0.1:43623 2837s 2024-11-24 00:47:11,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43135 2837s 2024-11-24 00:47:11,387 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:11,387 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:11,387 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:11,387 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-69u08s4l 2837s 2024-11-24 00:47:11,387 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:11,388 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32787. Reason: failure-to-start- 2837s 2024-11-24 00:47:11,388 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:11,388 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38523. Reason: failure-to-start- 2837s 2024-11-24 00:47:11,388 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:11,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43135': TLS handshake failed with remote 'tls://127.0.0.1:51872': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:11,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43135': TLS handshake failed with remote 'tls://127.0.0.1:51884': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:11,390 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:12,394 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:12,398 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46807 2837s 2024-11-24 00:47:12,398 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34479/status 2837s 2024-11-24 00:47:12,399 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:12,407 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33773 2837s 2024-11-24 00:47:12,407 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33773 2837s 2024-11-24 00:47:12,407 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:12,407 - distributed.worker - INFO - dashboard at: 127.0.0.1:40139 2837s 2024-11-24 00:47:12,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46807 2837s 2024-11-24 00:47:12,407 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:12,407 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:12,407 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:12,407 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p6velvbn 2837s 2024-11-24 00:47:12,407 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:12,409 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44235 2837s 2024-11-24 00:47:12,409 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44235 2837s 2024-11-24 00:47:12,409 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:12,409 - distributed.worker - INFO - dashboard at: 127.0.0.1:35819 2837s 2024-11-24 00:47:12,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46807 2837s 2024-11-24 00:47:12,409 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:12,409 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:12,409 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:12,409 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vwlg3709 2837s 2024-11-24 00:47:12,409 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:12,410 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33773. Reason: failure-to-start- 2837s 2024-11-24 00:47:12,411 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:12,411 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44235. Reason: failure-to-start- 2837s 2024-11-24 00:47:12,411 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:12,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46807': TLS handshake failed with remote 'tls://127.0.0.1:59478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:12,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46807': TLS handshake failed with remote 'tls://127.0.0.1:59480': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:12,413 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:13,417 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:13,421 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41503 2837s 2024-11-24 00:47:13,421 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39805/status 2837s 2024-11-24 00:47:13,422 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:13,430 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38191 2837s 2024-11-24 00:47:13,430 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38191 2837s 2024-11-24 00:47:13,430 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:13,430 - distributed.worker - INFO - dashboard at: 127.0.0.1:40269 2837s 2024-11-24 00:47:13,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 2837s 2024-11-24 00:47:13,430 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:13,430 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:13,430 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:13,430 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vdbyiank 2837s 2024-11-24 00:47:13,430 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:13,432 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43913 2837s 2024-11-24 00:47:13,432 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43913 2837s 2024-11-24 00:47:13,432 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:13,432 - distributed.worker - INFO - dashboard at: 127.0.0.1:38677 2837s 2024-11-24 00:47:13,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 2837s 2024-11-24 00:47:13,432 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:13,432 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:13,432 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:13,432 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rcdzg3fd 2837s 2024-11-24 00:47:13,432 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:13,433 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38191. Reason: failure-to-start- 2837s 2024-11-24 00:47:13,433 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:13,434 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43913. Reason: failure-to-start- 2837s 2024-11-24 00:47:13,434 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:13,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:40318': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:13,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:40334': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:13,435 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:14,441 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:14,445 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44059 2837s 2024-11-24 00:47:14,445 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43205/status 2837s 2024-11-24 00:47:14,445 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:14,454 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44607 2837s 2024-11-24 00:47:14,454 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44607 2837s 2024-11-24 00:47:14,454 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:14,454 - distributed.worker - INFO - dashboard at: 127.0.0.1:32923 2837s 2024-11-24 00:47:14,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44059 2837s 2024-11-24 00:47:14,454 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:14,454 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:14,454 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:14,454 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y7ejtcez 2837s 2024-11-24 00:47:14,454 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:14,456 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42799 2837s 2024-11-24 00:47:14,456 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42799 2837s 2024-11-24 00:47:14,457 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:14,457 - distributed.worker - INFO - dashboard at: 127.0.0.1:32979 2837s 2024-11-24 00:47:14,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44059 2837s 2024-11-24 00:47:14,457 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:14,457 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:14,457 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:14,457 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-37oam2dt 2837s 2024-11-24 00:47:14,457 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:14,459 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44607. Reason: failure-to-start- 2837s 2024-11-24 00:47:14,459 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:14,460 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42799. Reason: failure-to-start- 2837s 2024-11-24 00:47:14,460 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:14,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44059': TLS handshake failed with remote 'tls://127.0.0.1:54544': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:14,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44059': TLS handshake failed with remote 'tls://127.0.0.1:54554': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:14,463 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:15,468 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:15,472 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39125 2837s 2024-11-24 00:47:15,472 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44319/status 2837s 2024-11-24 00:47:15,472 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:15,482 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37799 2837s 2024-11-24 00:47:15,483 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37799 2837s 2024-11-24 00:47:15,483 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:15,483 - distributed.worker - INFO - dashboard at: 127.0.0.1:34619 2837s 2024-11-24 00:47:15,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39125 2837s 2024-11-24 00:47:15,483 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:15,483 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:15,483 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:15,483 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gy_zkqnl 2837s 2024-11-24 00:47:15,483 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:15,484 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37693 2837s 2024-11-24 00:47:15,485 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37693 2837s 2024-11-24 00:47:15,485 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:15,485 - distributed.worker - INFO - dashboard at: 127.0.0.1:34777 2837s 2024-11-24 00:47:15,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39125 2837s 2024-11-24 00:47:15,485 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:15,485 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:15,485 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:15,485 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dzpankqv 2837s 2024-11-24 00:47:15,485 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:15,486 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37799. Reason: failure-to-start- 2837s 2024-11-24 00:47:15,486 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:15,486 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37693. Reason: failure-to-start- 2837s 2024-11-24 00:47:15,486 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:15,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39125': TLS handshake failed with remote 'tls://127.0.0.1:46462': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:15,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39125': TLS handshake failed with remote 'tls://127.0.0.1:46476': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:15,488 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:16,494 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:16,498 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40201 2837s 2024-11-24 00:47:16,498 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34543/status 2837s 2024-11-24 00:47:16,499 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:16,509 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45233 2837s 2024-11-24 00:47:16,509 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45233 2837s 2024-11-24 00:47:16,509 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:16,509 - distributed.worker - INFO - dashboard at: 127.0.0.1:40415 2837s 2024-11-24 00:47:16,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40201 2837s 2024-11-24 00:47:16,510 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:16,510 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:16,510 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:16,510 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4cj9rk9v 2837s 2024-11-24 00:47:16,510 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:16,512 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44035 2837s 2024-11-24 00:47:16,512 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44035 2837s 2024-11-24 00:47:16,512 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:16,512 - distributed.worker - INFO - dashboard at: 127.0.0.1:36371 2837s 2024-11-24 00:47:16,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40201 2837s 2024-11-24 00:47:16,512 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:16,512 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:16,512 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:16,512 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4gzhjp2a 2837s 2024-11-24 00:47:16,512 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:16,513 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45233. Reason: failure-to-start- 2837s 2024-11-24 00:47:16,513 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:16,513 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44035. Reason: failure-to-start- 2837s 2024-11-24 00:47:16,513 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:16,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40201': TLS handshake failed with remote 'tls://127.0.0.1:39378': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:16,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40201': TLS handshake failed with remote 'tls://127.0.0.1:39390': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:16,516 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:17,521 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:17,525 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36301 2837s 2024-11-24 00:47:17,525 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38029/status 2837s 2024-11-24 00:47:17,525 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:17,534 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43137 2837s 2024-11-24 00:47:17,535 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43137 2837s 2024-11-24 00:47:17,535 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:17,535 - distributed.worker - INFO - dashboard at: 127.0.0.1:39127 2837s 2024-11-24 00:47:17,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36301 2837s 2024-11-24 00:47:17,535 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:17,535 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:17,535 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:17,535 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x5ydroy4 2837s 2024-11-24 00:47:17,535 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:17,543 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43935 2837s 2024-11-24 00:47:17,544 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43935 2837s 2024-11-24 00:47:17,544 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:17,544 - distributed.worker - INFO - dashboard at: 127.0.0.1:42343 2837s 2024-11-24 00:47:17,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36301 2837s 2024-11-24 00:47:17,544 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:17,544 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:17,544 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:17,544 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x0eyuvsx 2837s 2024-11-24 00:47:17,544 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:17,546 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43137. Reason: failure-to-start- 2837s 2024-11-24 00:47:17,546 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:17,547 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43935. Reason: failure-to-start- 2837s 2024-11-24 00:47:17,547 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:17,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36301': TLS handshake failed with remote 'tls://127.0.0.1:44376': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:17,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36301': TLS handshake failed with remote 'tls://127.0.0.1:44392': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:17,549 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:18,554 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:18,557 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39135 2837s 2024-11-24 00:47:18,558 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36601/status 2837s 2024-11-24 00:47:18,558 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:18,566 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40279 2837s 2024-11-24 00:47:18,566 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40279 2837s 2024-11-24 00:47:18,567 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:18,567 - distributed.worker - INFO - dashboard at: 127.0.0.1:38869 2837s 2024-11-24 00:47:18,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39135 2837s 2024-11-24 00:47:18,567 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:18,567 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:18,567 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:18,567 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c_91t6zf 2837s 2024-11-24 00:47:18,567 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:18,568 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45115 2837s 2024-11-24 00:47:18,569 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45115 2837s 2024-11-24 00:47:18,569 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:18,569 - distributed.worker - INFO - dashboard at: 127.0.0.1:45805 2837s 2024-11-24 00:47:18,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39135 2837s 2024-11-24 00:47:18,569 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:18,569 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:18,569 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:18,569 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f7nwct49 2837s 2024-11-24 00:47:18,569 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:18,571 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40279. Reason: failure-to-start- 2837s 2024-11-24 00:47:18,571 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:18,571 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45115. Reason: failure-to-start- 2837s 2024-11-24 00:47:18,571 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:18,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39135': TLS handshake failed with remote 'tls://127.0.0.1:33240': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:18,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39135': TLS handshake failed with remote 'tls://127.0.0.1:33250': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:18,573 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:19,579 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:19,584 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38077 2837s 2024-11-24 00:47:19,584 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34959/status 2837s 2024-11-24 00:47:19,584 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:19,593 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45139 2837s 2024-11-24 00:47:19,593 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45139 2837s 2024-11-24 00:47:19,594 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:19,594 - distributed.worker - INFO - dashboard at: 127.0.0.1:39231 2837s 2024-11-24 00:47:19,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38077 2837s 2024-11-24 00:47:19,594 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:19,594 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:19,594 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:19,594 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lwn_dw62 2837s 2024-11-24 00:47:19,594 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:19,595 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46503 2837s 2024-11-24 00:47:19,596 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46503 2837s 2024-11-24 00:47:19,596 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:19,596 - distributed.worker - INFO - dashboard at: 127.0.0.1:42937 2837s 2024-11-24 00:47:19,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38077 2837s 2024-11-24 00:47:19,596 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:19,596 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:19,596 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:19,596 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mh_iqkmx 2837s 2024-11-24 00:47:19,596 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:19,597 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45139. Reason: failure-to-start- 2837s 2024-11-24 00:47:19,597 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:19,597 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46503. Reason: failure-to-start- 2837s 2024-11-24 00:47:19,597 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:19,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38077': TLS handshake failed with remote 'tls://127.0.0.1:48454': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:19,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38077': TLS handshake failed with remote 'tls://127.0.0.1:48468': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:19,600 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:20,605 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:20,608 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36619 2837s 2024-11-24 00:47:20,609 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44343/status 2837s 2024-11-24 00:47:20,609 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:20,631 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39043 2837s 2024-11-24 00:47:20,631 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39043 2837s 2024-11-24 00:47:20,631 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:20,631 - distributed.worker - INFO - dashboard at: 127.0.0.1:40489 2837s 2024-11-24 00:47:20,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36619 2837s 2024-11-24 00:47:20,631 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:20,631 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:20,631 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:20,631 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6i_9d1yc 2837s 2024-11-24 00:47:20,632 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:20,633 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36713 2837s 2024-11-24 00:47:20,633 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36713 2837s 2024-11-24 00:47:20,633 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:20,633 - distributed.worker - INFO - dashboard at: 127.0.0.1:33731 2837s 2024-11-24 00:47:20,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36619 2837s 2024-11-24 00:47:20,633 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:20,633 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:20,633 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:20,633 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rkk2l4v5 2837s 2024-11-24 00:47:20,633 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:20,635 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39043. Reason: failure-to-start- 2837s 2024-11-24 00:47:20,635 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:20,636 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36713. Reason: failure-to-start- 2837s 2024-11-24 00:47:20,636 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:20,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36619': TLS handshake failed with remote 'tls://127.0.0.1:42450': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:20,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36619': TLS handshake failed with remote 'tls://127.0.0.1:42452': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:20,637 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:21,642 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:21,646 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42417 2837s 2024-11-24 00:47:21,647 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41041/status 2837s 2024-11-24 00:47:21,647 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:21,657 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32847 2837s 2024-11-24 00:47:21,657 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32847 2837s 2024-11-24 00:47:21,657 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:21,657 - distributed.worker - INFO - dashboard at: 127.0.0.1:42725 2837s 2024-11-24 00:47:21,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42417 2837s 2024-11-24 00:47:21,657 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:21,657 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:21,657 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:21,657 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3u9hqfs9 2837s 2024-11-24 00:47:21,657 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:21,658 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33367 2837s 2024-11-24 00:47:21,658 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33367 2837s 2024-11-24 00:47:21,659 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:21,659 - distributed.worker - INFO - dashboard at: 127.0.0.1:34369 2837s 2024-11-24 00:47:21,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42417 2837s 2024-11-24 00:47:21,659 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:21,659 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:21,659 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:21,659 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ju8vhh1b 2837s 2024-11-24 00:47:21,659 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:21,660 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32847. Reason: failure-to-start- 2837s 2024-11-24 00:47:21,660 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:21,660 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33367. Reason: failure-to-start- 2837s 2024-11-24 00:47:21,660 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:21,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42417': TLS handshake failed with remote 'tls://127.0.0.1:38518': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:21,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42417': TLS handshake failed with remote 'tls://127.0.0.1:38534': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:21,662 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:22,668 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:22,672 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44087 2837s 2024-11-24 00:47:22,672 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38693/status 2837s 2024-11-24 00:47:22,672 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:22,681 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32811 2837s 2024-11-24 00:47:22,681 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32811 2837s 2024-11-24 00:47:22,681 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:22,681 - distributed.worker - INFO - dashboard at: 127.0.0.1:39927 2837s 2024-11-24 00:47:22,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44087 2837s 2024-11-24 00:47:22,681 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:22,681 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:22,681 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:22,681 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5xa421z3 2837s 2024-11-24 00:47:22,681 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:22,683 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45481 2837s 2024-11-24 00:47:22,683 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45481 2837s 2024-11-24 00:47:22,683 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:22,683 - distributed.worker - INFO - dashboard at: 127.0.0.1:35101 2837s 2024-11-24 00:47:22,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44087 2837s 2024-11-24 00:47:22,683 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:22,683 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:22,683 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:22,683 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3pbrpgy0 2837s 2024-11-24 00:47:22,683 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:22,684 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32811. Reason: failure-to-start- 2837s 2024-11-24 00:47:22,684 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:22,684 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45481. Reason: failure-to-start- 2837s 2024-11-24 00:47:22,684 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:22,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44087': TLS handshake failed with remote 'tls://127.0.0.1:46730': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:22,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44087': TLS handshake failed with remote 'tls://127.0.0.1:46746': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:22,686 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:23,691 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:23,695 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46349 2837s 2024-11-24 00:47:23,695 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38793/status 2837s 2024-11-24 00:47:23,695 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:23,703 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39707 2837s 2024-11-24 00:47:23,704 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39707 2837s 2024-11-24 00:47:23,704 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:23,704 - distributed.worker - INFO - dashboard at: 127.0.0.1:42751 2837s 2024-11-24 00:47:23,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46349 2837s 2024-11-24 00:47:23,704 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:23,704 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:23,704 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:23,704 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7aov461h 2837s 2024-11-24 00:47:23,704 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:23,705 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45933 2837s 2024-11-24 00:47:23,705 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45933 2837s 2024-11-24 00:47:23,705 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:23,705 - distributed.worker - INFO - dashboard at: 127.0.0.1:39735 2837s 2024-11-24 00:47:23,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46349 2837s 2024-11-24 00:47:23,705 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:23,705 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:23,706 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:23,706 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-md_fuygc 2837s 2024-11-24 00:47:23,706 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:23,706 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39707. Reason: failure-to-start- 2837s 2024-11-24 00:47:23,707 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:23,707 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45933. Reason: failure-to-start- 2837s 2024-11-24 00:47:23,707 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:23,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46349': TLS handshake failed with remote 'tls://127.0.0.1:45326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:23,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46349': TLS handshake failed with remote 'tls://127.0.0.1:45342': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:23,709 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:24,713 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:24,719 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37423 2837s 2024-11-24 00:47:24,719 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34487/status 2837s 2024-11-24 00:47:24,720 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:24,728 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45417 2837s 2024-11-24 00:47:24,728 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45417 2837s 2024-11-24 00:47:24,729 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:24,729 - distributed.worker - INFO - dashboard at: 127.0.0.1:46859 2837s 2024-11-24 00:47:24,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37423 2837s 2024-11-24 00:47:24,729 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:24,729 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:24,729 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:24,729 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-moi9m9mb 2837s 2024-11-24 00:47:24,729 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:24,730 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44763 2837s 2024-11-24 00:47:24,730 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44763 2837s 2024-11-24 00:47:24,730 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:24,730 - distributed.worker - INFO - dashboard at: 127.0.0.1:39933 2837s 2024-11-24 00:47:24,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37423 2837s 2024-11-24 00:47:24,731 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:24,731 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:24,731 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:24,731 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kj__ittq 2837s 2024-11-24 00:47:24,731 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:24,731 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45417. Reason: failure-to-start- 2837s 2024-11-24 00:47:24,732 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:24,732 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44763. Reason: failure-to-start- 2837s 2024-11-24 00:47:24,732 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:24,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37423': TLS handshake failed with remote 'tls://127.0.0.1:58692': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:24,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37423': TLS handshake failed with remote 'tls://127.0.0.1:58702': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:24,734 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:25,738 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:25,742 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44335 2837s 2024-11-24 00:47:25,743 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45089/status 2837s 2024-11-24 00:47:25,743 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:25,754 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42249 2837s 2024-11-24 00:47:25,754 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42249 2837s 2024-11-24 00:47:25,754 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:25,754 - distributed.worker - INFO - dashboard at: 127.0.0.1:35953 2837s 2024-11-24 00:47:25,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44335 2837s 2024-11-24 00:47:25,754 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:25,754 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:25,754 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:25,754 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-47f43h06 2837s 2024-11-24 00:47:25,754 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:25,756 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35621 2837s 2024-11-24 00:47:25,756 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35621 2837s 2024-11-24 00:47:25,756 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:25,756 - distributed.worker - INFO - dashboard at: 127.0.0.1:41291 2837s 2024-11-24 00:47:25,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44335 2837s 2024-11-24 00:47:25,756 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:25,756 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:25,756 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:25,756 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kn214189 2837s 2024-11-24 00:47:25,756 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:25,757 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42249. Reason: failure-to-start- 2837s 2024-11-24 00:47:25,757 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:25,757 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35621. Reason: failure-to-start- 2837s 2024-11-24 00:47:25,757 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:25,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44335': TLS handshake failed with remote 'tls://127.0.0.1:53950': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:25,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44335': TLS handshake failed with remote 'tls://127.0.0.1:53958': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:25,759 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:26,764 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:26,768 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37313 2837s 2024-11-24 00:47:26,768 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37441/status 2837s 2024-11-24 00:47:26,768 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:26,776 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33907 2837s 2024-11-24 00:47:26,776 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33907 2837s 2024-11-24 00:47:26,776 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:26,776 - distributed.worker - INFO - dashboard at: 127.0.0.1:45869 2837s 2024-11-24 00:47:26,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37313 2837s 2024-11-24 00:47:26,776 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:26,776 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:26,776 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:26,776 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wxg41gc6 2837s 2024-11-24 00:47:26,776 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:26,777 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46443 2837s 2024-11-24 00:47:26,778 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46443 2837s 2024-11-24 00:47:26,778 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:26,778 - distributed.worker - INFO - dashboard at: 127.0.0.1:32845 2837s 2024-11-24 00:47:26,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37313 2837s 2024-11-24 00:47:26,778 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:26,778 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:26,778 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:26,779 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9qlbpz2u 2837s 2024-11-24 00:47:26,779 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:26,780 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33907. Reason: failure-to-start- 2837s 2024-11-24 00:47:26,780 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:26,780 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46443. Reason: failure-to-start- 2837s 2024-11-24 00:47:26,780 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:26,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37313': TLS handshake failed with remote 'tls://127.0.0.1:36272': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:26,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37313': TLS handshake failed with remote 'tls://127.0.0.1:36280': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:26,782 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:27,787 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:27,791 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41073 2837s 2024-11-24 00:47:27,791 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45549/status 2837s 2024-11-24 00:47:27,791 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:27,800 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42947 2837s 2024-11-24 00:47:27,800 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42947 2837s 2024-11-24 00:47:27,800 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:27,800 - distributed.worker - INFO - dashboard at: 127.0.0.1:42033 2837s 2024-11-24 00:47:27,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41073 2837s 2024-11-24 00:47:27,800 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:27,800 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:27,801 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:27,801 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_4dk1wdw 2837s 2024-11-24 00:47:27,801 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:27,802 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33883 2837s 2024-11-24 00:47:27,802 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33883 2837s 2024-11-24 00:47:27,802 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:27,802 - distributed.worker - INFO - dashboard at: 127.0.0.1:43691 2837s 2024-11-24 00:47:27,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41073 2837s 2024-11-24 00:47:27,802 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:27,802 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:27,802 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:27,802 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jy6uxtcb 2837s 2024-11-24 00:47:27,802 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:27,803 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42947. Reason: failure-to-start- 2837s 2024-11-24 00:47:27,803 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:27,804 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33883. Reason: failure-to-start- 2837s 2024-11-24 00:47:27,804 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:27,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41073': TLS handshake failed with remote 'tls://127.0.0.1:44158': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:27,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41073': TLS handshake failed with remote 'tls://127.0.0.1:44164': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:27,805 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:47:28,811 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:28,815 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36083 2837s 2024-11-24 00:47:28,816 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35779/status 2837s 2024-11-24 00:47:28,816 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:28,827 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46107 2837s 2024-11-24 00:47:28,827 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46107 2837s 2024-11-24 00:47:28,827 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:28,827 - distributed.worker - INFO - dashboard at: 127.0.0.1:33315 2837s 2024-11-24 00:47:28,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36083 2837s 2024-11-24 00:47:28,827 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:28,827 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:28,827 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:28,827 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ayyqzxwy 2837s 2024-11-24 00:47:28,827 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:28,829 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37535 2837s 2024-11-24 00:47:28,829 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37535 2837s 2024-11-24 00:47:28,829 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:28,829 - distributed.worker - INFO - dashboard at: 127.0.0.1:45097 2837s 2024-11-24 00:47:28,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36083 2837s 2024-11-24 00:47:28,829 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:28,829 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:28,829 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:28,829 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n1527n1q 2837s 2024-11-24 00:47:28,829 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:28,830 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46107. Reason: failure-to-start- 2837s 2024-11-24 00:47:28,830 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:28,830 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37535. Reason: failure-to-start- 2837s 2024-11-24 00:47:28,830 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:28,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36083': TLS handshake failed with remote 'tls://127.0.0.1:49836': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:28,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36083': TLS handshake failed with remote 'tls://127.0.0.1:49852': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:28,833 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s _________________________________ test_scatter _________________________________ 2837s 2837s fut = , timeout = 0 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 2837s await self._register_with_scheduler() 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2837s comm = await wait_for( 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2837s return await fut 2837s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 2837s stream = await self.client.connect( 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s host = '127.0.0.1', port = 44805, af = 2837s ssl_options = 2837s max_buffer_size = 4151066624.0, source_ip = None, source_port = None 2837s timeout = None 2837s 2837s async def connect( 2837s self, 2837s host: str, 2837s port: int, 2837s af: socket.AddressFamily = socket.AF_UNSPEC, 2837s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 2837s max_buffer_size: Optional[int] = None, 2837s source_ip: Optional[str] = None, 2837s source_port: Optional[int] = None, 2837s timeout: Optional[Union[float, datetime.timedelta]] = None, 2837s ) -> IOStream: 2837s """Connect to the given host and port. 2837s 2837s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 2837s ``ssl_options`` is not None). 2837s 2837s Using the ``source_ip`` kwarg, one can specify the source 2837s IP address to use when establishing the connection. 2837s In case the user needs to resolve and 2837s use a specific interface, it has to be handled outside 2837s of Tornado as this depends very much on the platform. 2837s 2837s Raises `TimeoutError` if the input future does not complete before 2837s ``timeout``, which may be specified in any form allowed by 2837s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 2837s relative to `.IOLoop.time`) 2837s 2837s Similarly, when the user requires a certain source port, it can 2837s be specified using the ``source_port`` arg. 2837s 2837s .. versionchanged:: 4.5 2837s Added the ``source_ip`` and ``source_port`` arguments. 2837s 2837s .. versionchanged:: 5.0 2837s Added the ``timeout`` argument. 2837s """ 2837s if timeout is not None: 2837s if isinstance(timeout, numbers.Real): 2837s timeout = IOLoop.current().time() + timeout 2837s elif isinstance(timeout, datetime.timedelta): 2837s timeout = IOLoop.current().time() + timeout.total_seconds() 2837s else: 2837s raise TypeError("Unsupported timeout %r" % timeout) 2837s if timeout is not None: 2837s addrinfo = await gen.with_timeout( 2837s timeout, self.resolver.resolve(host, port, af) 2837s ) 2837s else: 2837s addrinfo = await self.resolver.resolve(host, port, af) 2837s connector = _Connector( 2837s addrinfo, 2837s functools.partial( 2837s self._create_stream, 2837s max_buffer_size, 2837s source_ip=source_ip, 2837s source_port=source_port, 2837s ), 2837s ) 2837s > af, addr, stream = await connector.start(connect_timeout=timeout) 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s > await wait_for(self.start_unsafe(), timeout=timeout) 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:664: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s @contextlib.asynccontextmanager 2837s async def _cluster_factory(): 2837s workers = [] 2837s s = None 2837s try: 2837s for _ in range(60): 2837s try: 2837s > s, ws = await start_cluster( 2837s nthreads, 2837s scheduler, 2837s security=security, 2837s Worker=Worker, 2837s scheduler_kwargs=scheduler_kwargs, 2837s worker_kwargs=merge( 2837s {"death_timeout": min(15, int(deadline.remaining))}, 2837s worker_kwargs, 2837s ), 2837s ) 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 2837s await asyncio.gather(*workers) 2837s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 2837s return await awaitable 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s except asyncio.TimeoutError as exc: 2837s await _close_on_failure(exc) 2837s > raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s E TimeoutError: Worker start timed out after 0s. 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s fut = ._..test_func..async_fn at 0xe63f7717a820> 2837s timeout = 60 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 2837s _cluster_factory() as (s, workers), 2837s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 2837s return await anext(self.gen) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 2837s await asyncio.sleep(1) 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s delay = 1, result = None 2837s 2837s async def sleep(delay, result=None): 2837s """Coroutine that completes after a given time (in seconds).""" 2837s if delay <= 0: 2837s await __sleep0() 2837s return result 2837s 2837s if math.isnan(delay): 2837s raise ValueError("Invalid delay: NaN (not a number)") 2837s 2837s loop = events.get_running_loop() 2837s future = loop.create_future() 2837s h = loop.call_later(delay, 2837s futures._set_result_unless_cancelled, 2837s future, result) 2837s try: 2837s > return await future 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s args = (), kwds = {} 2837s 2837s @wraps(func) 2837s def inner(*args, **kwds): 2837s with self._recreate_cm(): 2837s > return func(*args, **kwds) 2837s 2837s /usr/lib/python3.13/contextlib.py:85: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3.13/contextlib.py:85: in inner 2837s return func(*args, **kwds) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 2837s return _run_and_close_tornado(async_fn_outer) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 2837s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 2837s /usr/lib/python3.13/asyncio/runners.py:194: in run 2837s return runner.run(main) 2837s /usr/lib/python3.13/asyncio/runners.py:118: in run 2837s return self._loop.run_until_complete(task) 2837s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 2837s return future.result() 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 2837s return await async_fn(*args, **kwargs) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 2837s return await utils_wait_for(async_fn(), timeout=timeout * 2) 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s ----------------------------- Captured stderr call ----------------------------- 2837s 2024-11-24 00:47:29,545 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:29,549 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:29,550 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33671/status 2837s 2024-11-24 00:47:29,550 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:29,557 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41367 2837s 2024-11-24 00:47:29,557 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41367 2837s 2024-11-24 00:47:29,557 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:29,558 - distributed.worker - INFO - dashboard at: 127.0.0.1:46753 2837s 2024-11-24 00:47:29,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:29,558 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:29,558 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:29,558 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:29,558 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dtb9pn_0 2837s 2024-11-24 00:47:29,558 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:29,559 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39493 2837s 2024-11-24 00:47:29,559 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39493 2837s 2024-11-24 00:47:29,559 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:29,559 - distributed.worker - INFO - dashboard at: 127.0.0.1:38299 2837s 2024-11-24 00:47:29,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:29,559 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:29,559 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:29,559 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:29,559 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fb51tg7h 2837s 2024-11-24 00:47:29,559 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:29,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:29,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:29,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:29,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:29,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:29,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:29,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:29,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:29,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:29,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:29,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:29,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:29,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:29,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:29,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:29,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:30,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:30,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:31,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:31,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:44996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:32,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:32,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:33,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:33,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:34,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:34,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:45470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:53984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:53990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:53996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:53998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:35,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:35,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:36,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:36,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:37,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:37,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:38,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:38,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:39,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:39,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:40,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:40,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:54984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:41,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:41,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:42,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:42,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:43,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:43,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:44,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:44,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:44,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:44,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:44,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:44,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:44,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:44,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:44,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:44,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:44,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:44,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:44,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:44,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:44,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:44,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:44,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:44,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:44,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:44,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:44,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37371 2837s 2024-11-24 00:47:44,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37371': TLS handshake failed with remote 'tls://127.0.0.1:55496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:44,557 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41367. Reason: failure-to-start- 2837s 2024-11-24 00:47:44,557 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:44,558 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 15s. 2837s 2024-11-24 00:47:44,561 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39493. Reason: failure-to-start- 2837s 2024-11-24 00:47:44,561 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:45,564 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:45,569 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:45,569 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43775/status 2837s 2024-11-24 00:47:45,569 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:45,577 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34687 2837s 2024-11-24 00:47:45,577 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34687 2837s 2024-11-24 00:47:45,577 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:45,577 - distributed.worker - INFO - dashboard at: 127.0.0.1:37387 2837s 2024-11-24 00:47:45,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:45,577 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:45,577 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:45,577 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:45,577 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u5bdsnkz 2837s 2024-11-24 00:47:45,577 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:45,579 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45375 2837s 2024-11-24 00:47:45,579 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45375 2837s 2024-11-24 00:47:45,579 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:45,579 - distributed.worker - INFO - dashboard at: 127.0.0.1:39455 2837s 2024-11-24 00:47:45,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:45,579 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:45,579 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:45,579 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:45,579 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qvg9sdyt 2837s 2024-11-24 00:47:45,579 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:45,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:45,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:45,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:45,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:45,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:45,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:45,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:45,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:45,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:45,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:45,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:45,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:45,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:45,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:45,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:45,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:46,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:46,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:47,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:47,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:48,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:48,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:49,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:49,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:50,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:50,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:51,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:51,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:52,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:52,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:53,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:53,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:54,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:54,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:55,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:55,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:56,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:56,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:57,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:57,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:52994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:58,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:58,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:58,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:58,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:58,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:58,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:58,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:58,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:58,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:58,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:58,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:58,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:58,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:58,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:58,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:58,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:58,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:58,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:58,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:58,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:58,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:58,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:58,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39181 2837s 2024-11-24 00:47:58,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:53106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:47:58,576 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34687. Reason: failure-to-start- 2837s 2024-11-24 00:47:58,577 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:58,578 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 13s. 2837s 2024-11-24 00:47:58,581 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45375. Reason: failure-to-start- 2837s 2024-11-24 00:47:58,581 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:59,584 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:47:59,588 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34909 2837s 2024-11-24 00:47:59,589 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33691/status 2837s 2024-11-24 00:47:59,589 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:47:59,599 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44999 2837s 2024-11-24 00:47:59,599 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44999 2837s 2024-11-24 00:47:59,599 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:47:59,599 - distributed.worker - INFO - dashboard at: 127.0.0.1:46163 2837s 2024-11-24 00:47:59,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34909 2837s 2024-11-24 00:47:59,599 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:59,599 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:47:59,599 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:59,599 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vlz5cl7e 2837s 2024-11-24 00:47:59,600 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:59,601 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38361 2837s 2024-11-24 00:47:59,601 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38361 2837s 2024-11-24 00:47:59,601 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:47:59,601 - distributed.worker - INFO - dashboard at: 127.0.0.1:44495 2837s 2024-11-24 00:47:59,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34909 2837s 2024-11-24 00:47:59,601 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:59,602 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:47:59,602 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:47:59,602 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3b2dncdl 2837s 2024-11-24 00:47:59,602 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:47:59,602 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44999. Reason: failure-to-start- 2837s 2024-11-24 00:47:59,603 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:59,603 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38361. Reason: failure-to-start- 2837s 2024-11-24 00:47:59,603 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:47:59,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34909': TLS handshake failed with remote 'tls://127.0.0.1:37128': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:59,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34909': TLS handshake failed with remote 'tls://127.0.0.1:37130': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:47:59,605 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:00,610 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:00,614 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45961 2837s 2024-11-24 00:48:00,614 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37229/status 2837s 2024-11-24 00:48:00,614 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:00,623 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40415 2837s 2024-11-24 00:48:00,623 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40415 2837s 2024-11-24 00:48:00,624 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:00,624 - distributed.worker - INFO - dashboard at: 127.0.0.1:45197 2837s 2024-11-24 00:48:00,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45961 2837s 2024-11-24 00:48:00,624 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:00,624 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:00,624 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:00,624 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7luglirv 2837s 2024-11-24 00:48:00,624 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:00,626 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44601 2837s 2024-11-24 00:48:00,626 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44601 2837s 2024-11-24 00:48:00,626 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:00,626 - distributed.worker - INFO - dashboard at: 127.0.0.1:37789 2837s 2024-11-24 00:48:00,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45961 2837s 2024-11-24 00:48:00,626 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:00,626 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:00,626 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:00,626 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b_yw9wr8 2837s 2024-11-24 00:48:00,626 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:00,631 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40415. Reason: failure-to-start- 2837s 2024-11-24 00:48:00,631 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:00,631 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44601. Reason: failure-to-start- 2837s 2024-11-24 00:48:00,632 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:00,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45961': TLS handshake failed with remote 'tls://127.0.0.1:47628': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:00,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45961': TLS handshake failed with remote 'tls://127.0.0.1:47638': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:00,634 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:01,639 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:01,643 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41903 2837s 2024-11-24 00:48:01,643 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43863/status 2837s 2024-11-24 00:48:01,644 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:01,653 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38019 2837s 2024-11-24 00:48:01,653 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38019 2837s 2024-11-24 00:48:01,653 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:01,653 - distributed.worker - INFO - dashboard at: 127.0.0.1:45193 2837s 2024-11-24 00:48:01,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41903 2837s 2024-11-24 00:48:01,653 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:01,654 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:01,654 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:01,654 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rwdwvd90 2837s 2024-11-24 00:48:01,654 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:01,655 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43085 2837s 2024-11-24 00:48:01,655 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43085 2837s 2024-11-24 00:48:01,655 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:01,655 - distributed.worker - INFO - dashboard at: 127.0.0.1:34307 2837s 2024-11-24 00:48:01,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41903 2837s 2024-11-24 00:48:01,656 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:01,656 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:01,656 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:01,656 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ufty_15d 2837s 2024-11-24 00:48:01,656 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:01,656 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38019. Reason: failure-to-start- 2837s 2024-11-24 00:48:01,657 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:01,657 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43085. Reason: failure-to-start- 2837s 2024-11-24 00:48:01,657 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:01,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41903': TLS handshake failed with remote 'tls://127.0.0.1:37454': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:01,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41903': TLS handshake failed with remote 'tls://127.0.0.1:37462': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:01,659 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:02,664 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:02,668 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37191 2837s 2024-11-24 00:48:02,669 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46861/status 2837s 2024-11-24 00:48:02,669 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:02,680 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34615 2837s 2024-11-24 00:48:02,680 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34615 2837s 2024-11-24 00:48:02,680 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:02,680 - distributed.worker - INFO - dashboard at: 127.0.0.1:42761 2837s 2024-11-24 00:48:02,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37191 2837s 2024-11-24 00:48:02,681 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:02,681 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:02,681 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:02,681 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bgl1kb1v 2837s 2024-11-24 00:48:02,681 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:02,683 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39947 2837s 2024-11-24 00:48:02,683 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39947 2837s 2024-11-24 00:48:02,683 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:02,683 - distributed.worker - INFO - dashboard at: 127.0.0.1:36367 2837s 2024-11-24 00:48:02,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37191 2837s 2024-11-24 00:48:02,683 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:02,683 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:02,683 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:02,683 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8att5f59 2837s 2024-11-24 00:48:02,683 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:02,684 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34615. Reason: failure-to-start- 2837s 2024-11-24 00:48:02,684 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:02,685 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39947. Reason: failure-to-start- 2837s 2024-11-24 00:48:02,685 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:02,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37191': TLS handshake failed with remote 'tls://127.0.0.1:39362': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:02,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37191': TLS handshake failed with remote 'tls://127.0.0.1:39366': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:02,687 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:03,692 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:03,697 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43895 2837s 2024-11-24 00:48:03,697 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40585/status 2837s 2024-11-24 00:48:03,697 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:03,707 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33585 2837s 2024-11-24 00:48:03,707 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33585 2837s 2024-11-24 00:48:03,707 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:03,707 - distributed.worker - INFO - dashboard at: 127.0.0.1:39671 2837s 2024-11-24 00:48:03,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43895 2837s 2024-11-24 00:48:03,707 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:03,707 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:03,707 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:03,707 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ipgow81q 2837s 2024-11-24 00:48:03,707 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:03,709 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33469 2837s 2024-11-24 00:48:03,709 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33469 2837s 2024-11-24 00:48:03,709 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:03,709 - distributed.worker - INFO - dashboard at: 127.0.0.1:37737 2837s 2024-11-24 00:48:03,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43895 2837s 2024-11-24 00:48:03,709 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:03,709 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:03,709 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:03,709 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k5ksg441 2837s 2024-11-24 00:48:03,709 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:03,710 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33585. Reason: failure-to-start- 2837s 2024-11-24 00:48:03,710 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:03,711 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33469. Reason: failure-to-start- 2837s 2024-11-24 00:48:03,711 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:03,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43895': TLS handshake failed with remote 'tls://127.0.0.1:60668': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:03,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43895': TLS handshake failed with remote 'tls://127.0.0.1:60678': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:03,713 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:04,717 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:04,722 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34359 2837s 2024-11-24 00:48:04,722 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42155/status 2837s 2024-11-24 00:48:04,722 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:04,731 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45983 2837s 2024-11-24 00:48:04,731 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45983 2837s 2024-11-24 00:48:04,731 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:04,732 - distributed.worker - INFO - dashboard at: 127.0.0.1:33643 2837s 2024-11-24 00:48:04,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34359 2837s 2024-11-24 00:48:04,732 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:04,732 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:04,732 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:04,732 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dohixxi9 2837s 2024-11-24 00:48:04,732 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:04,733 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46671 2837s 2024-11-24 00:48:04,734 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46671 2837s 2024-11-24 00:48:04,734 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:04,734 - distributed.worker - INFO - dashboard at: 127.0.0.1:42827 2837s 2024-11-24 00:48:04,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34359 2837s 2024-11-24 00:48:04,734 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:04,734 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:04,734 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:04,734 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k3rqvhoc 2837s 2024-11-24 00:48:04,734 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:04,735 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45983. Reason: failure-to-start- 2837s 2024-11-24 00:48:04,735 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:04,736 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46671. Reason: failure-to-start- 2837s 2024-11-24 00:48:04,736 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:04,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34359': TLS handshake failed with remote 'tls://127.0.0.1:51450': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:04,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34359': TLS handshake failed with remote 'tls://127.0.0.1:51456': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:04,738 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:05,742 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:05,746 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36597 2837s 2024-11-24 00:48:05,747 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34295/status 2837s 2024-11-24 00:48:05,747 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:05,756 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40587 2837s 2024-11-24 00:48:05,756 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40587 2837s 2024-11-24 00:48:05,756 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:05,756 - distributed.worker - INFO - dashboard at: 127.0.0.1:45473 2837s 2024-11-24 00:48:05,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36597 2837s 2024-11-24 00:48:05,756 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:05,756 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:05,756 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:05,756 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-15ajj0j5 2837s 2024-11-24 00:48:05,756 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:05,758 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35219 2837s 2024-11-24 00:48:05,758 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35219 2837s 2024-11-24 00:48:05,758 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:05,758 - distributed.worker - INFO - dashboard at: 127.0.0.1:36445 2837s 2024-11-24 00:48:05,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36597 2837s 2024-11-24 00:48:05,758 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:05,758 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:05,758 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:05,758 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3yxmp6ge 2837s 2024-11-24 00:48:05,758 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:05,759 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40587. Reason: failure-to-start- 2837s 2024-11-24 00:48:05,759 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:05,759 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35219. Reason: failure-to-start- 2837s 2024-11-24 00:48:05,760 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:05,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36597': TLS handshake failed with remote 'tls://127.0.0.1:37232': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:05,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36597': TLS handshake failed with remote 'tls://127.0.0.1:37244': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:05,762 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:06,766 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:06,772 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41279 2837s 2024-11-24 00:48:06,772 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37935/status 2837s 2024-11-24 00:48:06,772 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:06,781 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37967 2837s 2024-11-24 00:48:06,781 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37967 2837s 2024-11-24 00:48:06,781 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:06,781 - distributed.worker - INFO - dashboard at: 127.0.0.1:39157 2837s 2024-11-24 00:48:06,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41279 2837s 2024-11-24 00:48:06,781 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:06,781 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:06,781 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:06,781 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9n2y_14j 2837s 2024-11-24 00:48:06,781 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:06,783 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37441 2837s 2024-11-24 00:48:06,783 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37441 2837s 2024-11-24 00:48:06,783 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:06,783 - distributed.worker - INFO - dashboard at: 127.0.0.1:32859 2837s 2024-11-24 00:48:06,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41279 2837s 2024-11-24 00:48:06,783 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:06,783 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:06,783 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:06,783 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yaoof1wo 2837s 2024-11-24 00:48:06,783 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:06,784 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37967. Reason: failure-to-start- 2837s 2024-11-24 00:48:06,784 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:06,784 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37441. Reason: failure-to-start- 2837s 2024-11-24 00:48:06,784 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:06,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41279': TLS handshake failed with remote 'tls://127.0.0.1:47924': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:06,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41279': TLS handshake failed with remote 'tls://127.0.0.1:47926': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:06,786 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:07,791 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:07,795 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41281 2837s 2024-11-24 00:48:07,795 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41739/status 2837s 2024-11-24 00:48:07,796 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:07,805 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43867 2837s 2024-11-24 00:48:07,805 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43867 2837s 2024-11-24 00:48:07,805 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:07,805 - distributed.worker - INFO - dashboard at: 127.0.0.1:44953 2837s 2024-11-24 00:48:07,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 2837s 2024-11-24 00:48:07,805 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:07,805 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:07,805 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:07,806 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iwxsngvm 2837s 2024-11-24 00:48:07,806 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:07,807 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40185 2837s 2024-11-24 00:48:07,807 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40185 2837s 2024-11-24 00:48:07,807 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:07,807 - distributed.worker - INFO - dashboard at: 127.0.0.1:45331 2837s 2024-11-24 00:48:07,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 2837s 2024-11-24 00:48:07,807 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:07,807 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:07,807 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:07,807 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ah6d5q5n 2837s 2024-11-24 00:48:07,807 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:07,808 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43867. Reason: failure-to-start- 2837s 2024-11-24 00:48:07,808 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:07,809 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40185. Reason: failure-to-start- 2837s 2024-11-24 00:48:07,809 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:07,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:48668': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:07,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:48684': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:07,811 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:08,817 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:08,820 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36647 2837s 2024-11-24 00:48:08,821 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38033/status 2837s 2024-11-24 00:48:08,821 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:08,829 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42465 2837s 2024-11-24 00:48:08,829 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42465 2837s 2024-11-24 00:48:08,829 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:08,829 - distributed.worker - INFO - dashboard at: 127.0.0.1:45641 2837s 2024-11-24 00:48:08,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36647 2837s 2024-11-24 00:48:08,829 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:08,829 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:08,829 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:08,829 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-af13cwld 2837s 2024-11-24 00:48:08,829 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:08,831 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43405 2837s 2024-11-24 00:48:08,831 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43405 2837s 2024-11-24 00:48:08,831 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:08,831 - distributed.worker - INFO - dashboard at: 127.0.0.1:33375 2837s 2024-11-24 00:48:08,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36647 2837s 2024-11-24 00:48:08,831 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:08,831 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:08,831 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:08,831 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sl2a07uh 2837s 2024-11-24 00:48:08,831 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:08,833 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42465. Reason: failure-to-start- 2837s 2024-11-24 00:48:08,833 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:08,833 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43405. Reason: failure-to-start- 2837s 2024-11-24 00:48:08,833 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:08,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36647': TLS handshake failed with remote 'tls://127.0.0.1:57066': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:08,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36647': TLS handshake failed with remote 'tls://127.0.0.1:57072': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:08,835 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:09,839 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:09,843 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46647 2837s 2024-11-24 00:48:09,844 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34521/status 2837s 2024-11-24 00:48:09,844 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:09,853 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41587 2837s 2024-11-24 00:48:09,853 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41587 2837s 2024-11-24 00:48:09,853 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:09,853 - distributed.worker - INFO - dashboard at: 127.0.0.1:38401 2837s 2024-11-24 00:48:09,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46647 2837s 2024-11-24 00:48:09,853 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:09,853 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:09,853 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:09,853 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ttwdb2wx 2837s 2024-11-24 00:48:09,853 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:09,855 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41491 2837s 2024-11-24 00:48:09,855 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41491 2837s 2024-11-24 00:48:09,855 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:09,855 - distributed.worker - INFO - dashboard at: 127.0.0.1:41003 2837s 2024-11-24 00:48:09,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46647 2837s 2024-11-24 00:48:09,855 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:09,855 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:09,855 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:09,855 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lp30_tgo 2837s 2024-11-24 00:48:09,855 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:09,856 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41587. Reason: failure-to-start- 2837s 2024-11-24 00:48:09,856 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:09,857 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41491. Reason: failure-to-start- 2837s 2024-11-24 00:48:09,857 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:09,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46647': TLS handshake failed with remote 'tls://127.0.0.1:44584': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:09,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46647': TLS handshake failed with remote 'tls://127.0.0.1:44588': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:09,859 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:10,863 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:10,868 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43427 2837s 2024-11-24 00:48:10,869 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33147/status 2837s 2024-11-24 00:48:10,869 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:10,878 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37113 2837s 2024-11-24 00:48:10,878 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37113 2837s 2024-11-24 00:48:10,878 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:10,878 - distributed.worker - INFO - dashboard at: 127.0.0.1:43961 2837s 2024-11-24 00:48:10,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43427 2837s 2024-11-24 00:48:10,878 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:10,878 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:10,878 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:10,878 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2sfwq4bw 2837s 2024-11-24 00:48:10,879 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:10,880 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33159 2837s 2024-11-24 00:48:10,880 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33159 2837s 2024-11-24 00:48:10,880 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:10,880 - distributed.worker - INFO - dashboard at: 127.0.0.1:35935 2837s 2024-11-24 00:48:10,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43427 2837s 2024-11-24 00:48:10,880 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:10,880 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:10,881 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:10,881 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pz188vhm 2837s 2024-11-24 00:48:10,881 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:10,882 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37113. Reason: failure-to-start- 2837s 2024-11-24 00:48:10,882 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:10,882 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33159. Reason: failure-to-start- 2837s 2024-11-24 00:48:10,882 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:10,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43427': TLS handshake failed with remote 'tls://127.0.0.1:58878': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:10,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43427': TLS handshake failed with remote 'tls://127.0.0.1:58890': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:10,884 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:11,888 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:11,893 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45413 2837s 2024-11-24 00:48:11,893 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40179/status 2837s 2024-11-24 00:48:11,893 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:11,904 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46591 2837s 2024-11-24 00:48:11,904 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46591 2837s 2024-11-24 00:48:11,904 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:11,904 - distributed.worker - INFO - dashboard at: 127.0.0.1:34663 2837s 2024-11-24 00:48:11,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45413 2837s 2024-11-24 00:48:11,904 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:11,904 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:11,904 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:11,904 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rvlplgdu 2837s 2024-11-24 00:48:11,904 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:11,906 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35807 2837s 2024-11-24 00:48:11,906 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35807 2837s 2024-11-24 00:48:11,906 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:11,906 - distributed.worker - INFO - dashboard at: 127.0.0.1:45815 2837s 2024-11-24 00:48:11,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45413 2837s 2024-11-24 00:48:11,906 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:11,906 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:11,907 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:11,907 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uor5v5e6 2837s 2024-11-24 00:48:11,907 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:11,908 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46591. Reason: failure-to-start- 2837s 2024-11-24 00:48:11,908 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:11,908 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35807. Reason: failure-to-start- 2837s 2024-11-24 00:48:11,908 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:11,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45413': TLS handshake failed with remote 'tls://127.0.0.1:55952': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:11,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45413': TLS handshake failed with remote 'tls://127.0.0.1:55956': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:11,910 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:12,914 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:12,919 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35821 2837s 2024-11-24 00:48:12,919 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46185/status 2837s 2024-11-24 00:48:12,919 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:12,929 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35403 2837s 2024-11-24 00:48:12,929 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35403 2837s 2024-11-24 00:48:12,929 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:12,929 - distributed.worker - INFO - dashboard at: 127.0.0.1:43311 2837s 2024-11-24 00:48:12,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35821 2837s 2024-11-24 00:48:12,929 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:12,929 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:12,929 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:12,929 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3p9wdubo 2837s 2024-11-24 00:48:12,929 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:12,932 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36383 2837s 2024-11-24 00:48:12,932 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36383 2837s 2024-11-24 00:48:12,932 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:12,932 - distributed.worker - INFO - dashboard at: 127.0.0.1:38009 2837s 2024-11-24 00:48:12,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35821 2837s 2024-11-24 00:48:12,932 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:12,932 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:12,932 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:12,932 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6b0r2kgq 2837s 2024-11-24 00:48:12,932 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:12,933 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35403. Reason: failure-to-start- 2837s 2024-11-24 00:48:12,933 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:12,934 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36383. Reason: failure-to-start- 2837s 2024-11-24 00:48:12,934 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:12,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35821': TLS handshake failed with remote 'tls://127.0.0.1:51240': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:12,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35821': TLS handshake failed with remote 'tls://127.0.0.1:51246': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:12,936 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:13,940 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:13,944 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37119 2837s 2024-11-24 00:48:13,945 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41065/status 2837s 2024-11-24 00:48:13,945 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:13,954 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45407 2837s 2024-11-24 00:48:13,954 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45407 2837s 2024-11-24 00:48:13,954 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:13,954 - distributed.worker - INFO - dashboard at: 127.0.0.1:35795 2837s 2024-11-24 00:48:13,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37119 2837s 2024-11-24 00:48:13,954 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:13,954 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:13,954 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:13,954 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t__qbqxn 2837s 2024-11-24 00:48:13,954 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:13,956 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43491 2837s 2024-11-24 00:48:13,956 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43491 2837s 2024-11-24 00:48:13,956 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:13,956 - distributed.worker - INFO - dashboard at: 127.0.0.1:35949 2837s 2024-11-24 00:48:13,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37119 2837s 2024-11-24 00:48:13,956 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:13,956 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:13,956 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:13,956 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vfovozzh 2837s 2024-11-24 00:48:13,956 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:13,957 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45407. Reason: failure-to-start- 2837s 2024-11-24 00:48:13,957 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:13,958 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43491. Reason: failure-to-start- 2837s 2024-11-24 00:48:13,958 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:13,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37119': TLS handshake failed with remote 'tls://127.0.0.1:51500': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:13,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37119': TLS handshake failed with remote 'tls://127.0.0.1:51506': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:13,960 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:14,965 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:14,970 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45853 2837s 2024-11-24 00:48:14,970 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37179/status 2837s 2024-11-24 00:48:14,970 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:14,979 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39735 2837s 2024-11-24 00:48:14,979 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39735 2837s 2024-11-24 00:48:14,979 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:14,979 - distributed.worker - INFO - dashboard at: 127.0.0.1:44293 2837s 2024-11-24 00:48:14,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 2837s 2024-11-24 00:48:14,979 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:14,979 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:14,979 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:14,979 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ea3wlu75 2837s 2024-11-24 00:48:14,980 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:14,981 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39599 2837s 2024-11-24 00:48:14,981 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39599 2837s 2024-11-24 00:48:14,981 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:14,981 - distributed.worker - INFO - dashboard at: 127.0.0.1:34727 2837s 2024-11-24 00:48:14,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 2837s 2024-11-24 00:48:14,981 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:14,981 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:14,981 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:14,981 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eeprgc83 2837s 2024-11-24 00:48:14,982 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:14,982 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39735. Reason: failure-to-start- 2837s 2024-11-24 00:48:14,983 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:14,983 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39599. Reason: failure-to-start- 2837s 2024-11-24 00:48:14,983 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:14,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:38720': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:14,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:38732': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:14,985 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:15,990 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:15,994 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40255 2837s 2024-11-24 00:48:15,994 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33549/status 2837s 2024-11-24 00:48:15,994 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:16,005 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43843 2837s 2024-11-24 00:48:16,005 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43843 2837s 2024-11-24 00:48:16,005 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:16,005 - distributed.worker - INFO - dashboard at: 127.0.0.1:41045 2837s 2024-11-24 00:48:16,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40255 2837s 2024-11-24 00:48:16,005 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:16,005 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:16,005 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:16,005 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r1braupn 2837s 2024-11-24 00:48:16,005 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:16,007 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33175 2837s 2024-11-24 00:48:16,007 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33175 2837s 2024-11-24 00:48:16,007 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:16,007 - distributed.worker - INFO - dashboard at: 127.0.0.1:33831 2837s 2024-11-24 00:48:16,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40255 2837s 2024-11-24 00:48:16,007 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:16,007 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:16,007 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:16,007 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3z6j6izx 2837s 2024-11-24 00:48:16,007 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:16,008 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43843. Reason: failure-to-start- 2837s 2024-11-24 00:48:16,008 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:16,008 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33175. Reason: failure-to-start- 2837s 2024-11-24 00:48:16,009 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:16,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40255': TLS handshake failed with remote 'tls://127.0.0.1:35432': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:16,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40255': TLS handshake failed with remote 'tls://127.0.0.1:35440': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:16,011 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:17,016 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:17,020 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37531 2837s 2024-11-24 00:48:17,020 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46603/status 2837s 2024-11-24 00:48:17,021 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:17,030 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35067 2837s 2024-11-24 00:48:17,030 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35067 2837s 2024-11-24 00:48:17,030 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:17,030 - distributed.worker - INFO - dashboard at: 127.0.0.1:39395 2837s 2024-11-24 00:48:17,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37531 2837s 2024-11-24 00:48:17,030 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:17,030 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:17,031 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:17,031 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h55twkur 2837s 2024-11-24 00:48:17,031 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:17,045 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43773 2837s 2024-11-24 00:48:17,046 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43773 2837s 2024-11-24 00:48:17,046 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:17,046 - distributed.worker - INFO - dashboard at: 127.0.0.1:33805 2837s 2024-11-24 00:48:17,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37531 2837s 2024-11-24 00:48:17,046 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:17,046 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:17,046 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:17,046 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cuj3j14_ 2837s 2024-11-24 00:48:17,046 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:17,047 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35067. Reason: failure-to-start- 2837s 2024-11-24 00:48:17,047 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:17,047 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43773. Reason: failure-to-start- 2837s 2024-11-24 00:48:17,047 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:17,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37531': TLS handshake failed with remote 'tls://127.0.0.1:55298': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:17,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37531': TLS handshake failed with remote 'tls://127.0.0.1:55302': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:17,050 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:18,054 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:18,059 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42335 2837s 2024-11-24 00:48:18,059 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39631/status 2837s 2024-11-24 00:48:18,060 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:18,069 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41979 2837s 2024-11-24 00:48:18,069 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41979 2837s 2024-11-24 00:48:18,069 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:18,069 - distributed.worker - INFO - dashboard at: 127.0.0.1:46581 2837s 2024-11-24 00:48:18,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42335 2837s 2024-11-24 00:48:18,069 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:18,069 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:18,069 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:18,069 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p16etj8z 2837s 2024-11-24 00:48:18,069 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:18,071 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33159 2837s 2024-11-24 00:48:18,071 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33159 2837s 2024-11-24 00:48:18,071 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:18,071 - distributed.worker - INFO - dashboard at: 127.0.0.1:42247 2837s 2024-11-24 00:48:18,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42335 2837s 2024-11-24 00:48:18,071 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:18,071 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:18,071 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:18,071 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v8g7meen 2837s 2024-11-24 00:48:18,071 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:18,072 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41979. Reason: failure-to-start- 2837s 2024-11-24 00:48:18,072 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:18,073 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33159. Reason: failure-to-start- 2837s 2024-11-24 00:48:18,073 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:18,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42335': TLS handshake failed with remote 'tls://127.0.0.1:54422': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:18,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42335': TLS handshake failed with remote 'tls://127.0.0.1:54430': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:18,076 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:19,081 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:19,087 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37207 2837s 2024-11-24 00:48:19,087 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43831/status 2837s 2024-11-24 00:48:19,087 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:19,097 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45451 2837s 2024-11-24 00:48:19,097 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45451 2837s 2024-11-24 00:48:19,097 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:19,097 - distributed.worker - INFO - dashboard at: 127.0.0.1:33151 2837s 2024-11-24 00:48:19,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37207 2837s 2024-11-24 00:48:19,097 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:19,097 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:19,097 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:19,097 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-14e74ie3 2837s 2024-11-24 00:48:19,097 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:19,099 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36905 2837s 2024-11-24 00:48:19,099 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36905 2837s 2024-11-24 00:48:19,099 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:19,099 - distributed.worker - INFO - dashboard at: 127.0.0.1:38467 2837s 2024-11-24 00:48:19,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37207 2837s 2024-11-24 00:48:19,099 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:19,099 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:19,099 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:19,099 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gxbg0ovq 2837s 2024-11-24 00:48:19,099 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:19,101 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45451. Reason: failure-to-start- 2837s 2024-11-24 00:48:19,102 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:19,102 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36905. Reason: failure-to-start- 2837s 2024-11-24 00:48:19,102 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:19,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37207': TLS handshake failed with remote 'tls://127.0.0.1:54940': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:19,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37207': TLS handshake failed with remote 'tls://127.0.0.1:54956': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:19,104 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:20,110 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:20,114 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36855 2837s 2024-11-24 00:48:20,115 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45239/status 2837s 2024-11-24 00:48:20,115 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:20,126 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43819 2837s 2024-11-24 00:48:20,127 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43819 2837s 2024-11-24 00:48:20,127 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:20,127 - distributed.worker - INFO - dashboard at: 127.0.0.1:37329 2837s 2024-11-24 00:48:20,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36855 2837s 2024-11-24 00:48:20,127 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:20,127 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:20,127 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:20,127 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f8bu4_0h 2837s 2024-11-24 00:48:20,127 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:20,128 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38439 2837s 2024-11-24 00:48:20,129 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38439 2837s 2024-11-24 00:48:20,129 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:20,129 - distributed.worker - INFO - dashboard at: 127.0.0.1:44521 2837s 2024-11-24 00:48:20,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36855 2837s 2024-11-24 00:48:20,129 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:20,129 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:20,129 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:20,129 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4n80za_h 2837s 2024-11-24 00:48:20,129 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:20,130 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43819. Reason: failure-to-start- 2837s 2024-11-24 00:48:20,130 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:20,131 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38439. Reason: failure-to-start- 2837s 2024-11-24 00:48:20,131 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:20,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36855': TLS handshake failed with remote 'tls://127.0.0.1:32884': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:20,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36855': TLS handshake failed with remote 'tls://127.0.0.1:32898': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:20,132 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:21,137 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:21,141 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36281 2837s 2024-11-24 00:48:21,142 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35861/status 2837s 2024-11-24 00:48:21,142 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:21,151 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46793 2837s 2024-11-24 00:48:21,151 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46793 2837s 2024-11-24 00:48:21,151 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:21,151 - distributed.worker - INFO - dashboard at: 127.0.0.1:43657 2837s 2024-11-24 00:48:21,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36281 2837s 2024-11-24 00:48:21,151 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:21,151 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:21,151 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:21,151 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-72wrxj19 2837s 2024-11-24 00:48:21,151 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:21,153 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36459 2837s 2024-11-24 00:48:21,153 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36459 2837s 2024-11-24 00:48:21,153 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:21,153 - distributed.worker - INFO - dashboard at: 127.0.0.1:36713 2837s 2024-11-24 00:48:21,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36281 2837s 2024-11-24 00:48:21,153 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:21,153 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:21,153 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:21,153 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jg4n9ehm 2837s 2024-11-24 00:48:21,154 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:21,156 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46793. Reason: failure-to-start- 2837s 2024-11-24 00:48:21,157 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:21,157 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36459. Reason: failure-to-start- 2837s 2024-11-24 00:48:21,157 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:21,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36281': TLS handshake failed with remote 'tls://127.0.0.1:42346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:21,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36281': TLS handshake failed with remote 'tls://127.0.0.1:42348': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:21,159 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:22,163 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:22,167 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45495 2837s 2024-11-24 00:48:22,167 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34075/status 2837s 2024-11-24 00:48:22,168 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:22,176 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42395 2837s 2024-11-24 00:48:22,176 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42395 2837s 2024-11-24 00:48:22,176 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:22,176 - distributed.worker - INFO - dashboard at: 127.0.0.1:42535 2837s 2024-11-24 00:48:22,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45495 2837s 2024-11-24 00:48:22,177 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:22,177 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:22,177 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:22,177 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-63_6z3dd 2837s 2024-11-24 00:48:22,177 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:22,178 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34993 2837s 2024-11-24 00:48:22,178 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34993 2837s 2024-11-24 00:48:22,178 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:22,179 - distributed.worker - INFO - dashboard at: 127.0.0.1:42639 2837s 2024-11-24 00:48:22,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45495 2837s 2024-11-24 00:48:22,179 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:22,179 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:22,179 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:22,179 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nrrv7t35 2837s 2024-11-24 00:48:22,179 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:22,181 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42395. Reason: failure-to-start- 2837s 2024-11-24 00:48:22,181 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:22,181 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34993. Reason: failure-to-start- 2837s 2024-11-24 00:48:22,181 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:22,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45495': TLS handshake failed with remote 'tls://127.0.0.1:39028': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:22,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45495': TLS handshake failed with remote 'tls://127.0.0.1:39044': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:22,183 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:23,189 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:23,194 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32823 2837s 2024-11-24 00:48:23,194 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36361/status 2837s 2024-11-24 00:48:23,194 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:23,203 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38489 2837s 2024-11-24 00:48:23,203 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38489 2837s 2024-11-24 00:48:23,203 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:23,204 - distributed.worker - INFO - dashboard at: 127.0.0.1:41259 2837s 2024-11-24 00:48:23,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32823 2837s 2024-11-24 00:48:23,204 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:23,204 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:23,204 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:23,204 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_hhfqm79 2837s 2024-11-24 00:48:23,204 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:23,205 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44325 2837s 2024-11-24 00:48:23,205 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44325 2837s 2024-11-24 00:48:23,205 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:23,205 - distributed.worker - INFO - dashboard at: 127.0.0.1:39021 2837s 2024-11-24 00:48:23,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32823 2837s 2024-11-24 00:48:23,206 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:23,206 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:23,206 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:23,206 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nkq_kw98 2837s 2024-11-24 00:48:23,206 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:23,207 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38489. Reason: failure-to-start- 2837s 2024-11-24 00:48:23,207 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:23,208 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44325. Reason: failure-to-start- 2837s 2024-11-24 00:48:23,208 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:23,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32823': TLS handshake failed with remote 'tls://127.0.0.1:51166': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:23,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32823': TLS handshake failed with remote 'tls://127.0.0.1:51170': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:23,210 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:24,215 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:24,219 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46627 2837s 2024-11-24 00:48:24,219 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45087/status 2837s 2024-11-24 00:48:24,219 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:24,229 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38727 2837s 2024-11-24 00:48:24,229 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38727 2837s 2024-11-24 00:48:24,229 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:24,229 - distributed.worker - INFO - dashboard at: 127.0.0.1:42981 2837s 2024-11-24 00:48:24,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46627 2837s 2024-11-24 00:48:24,230 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:24,230 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:24,230 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:24,230 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ce0_6mzr 2837s 2024-11-24 00:48:24,230 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:24,231 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33273 2837s 2024-11-24 00:48:24,231 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33273 2837s 2024-11-24 00:48:24,231 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:24,231 - distributed.worker - INFO - dashboard at: 127.0.0.1:38663 2837s 2024-11-24 00:48:24,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46627 2837s 2024-11-24 00:48:24,232 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:24,232 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:24,232 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:24,232 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xiswf0ab 2837s 2024-11-24 00:48:24,232 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:24,233 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38727. Reason: failure-to-start- 2837s 2024-11-24 00:48:24,233 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:24,234 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33273. Reason: failure-to-start- 2837s 2024-11-24 00:48:24,234 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:24,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46627': TLS handshake failed with remote 'tls://127.0.0.1:55990': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:24,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46627': TLS handshake failed with remote 'tls://127.0.0.1:56006': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:24,235 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:25,240 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:25,244 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37221 2837s 2024-11-24 00:48:25,244 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40755/status 2837s 2024-11-24 00:48:25,244 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:25,254 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34297 2837s 2024-11-24 00:48:25,254 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34297 2837s 2024-11-24 00:48:25,254 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:25,254 - distributed.worker - INFO - dashboard at: 127.0.0.1:39565 2837s 2024-11-24 00:48:25,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37221 2837s 2024-11-24 00:48:25,254 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:25,254 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:25,254 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:25,254 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s8szuvw5 2837s 2024-11-24 00:48:25,254 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:25,256 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35193 2837s 2024-11-24 00:48:25,256 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35193 2837s 2024-11-24 00:48:25,256 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:25,256 - distributed.worker - INFO - dashboard at: 127.0.0.1:44017 2837s 2024-11-24 00:48:25,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37221 2837s 2024-11-24 00:48:25,256 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:25,256 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:25,256 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:25,256 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0yixvym9 2837s 2024-11-24 00:48:25,256 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:25,259 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34297. Reason: failure-to-start- 2837s 2024-11-24 00:48:25,259 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:25,260 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35193. Reason: failure-to-start- 2837s 2024-11-24 00:48:25,260 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:25,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37221': TLS handshake failed with remote 'tls://127.0.0.1:34038': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:25,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37221': TLS handshake failed with remote 'tls://127.0.0.1:34048': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:25,261 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:26,266 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:26,270 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36173 2837s 2024-11-24 00:48:26,270 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35421/status 2837s 2024-11-24 00:48:26,270 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:26,280 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34501 2837s 2024-11-24 00:48:26,280 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34501 2837s 2024-11-24 00:48:26,280 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:26,280 - distributed.worker - INFO - dashboard at: 127.0.0.1:41227 2837s 2024-11-24 00:48:26,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36173 2837s 2024-11-24 00:48:26,280 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:26,280 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:26,280 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:26,281 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ic2la4un 2837s 2024-11-24 00:48:26,281 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:26,282 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45443 2837s 2024-11-24 00:48:26,282 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45443 2837s 2024-11-24 00:48:26,282 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:26,282 - distributed.worker - INFO - dashboard at: 127.0.0.1:42435 2837s 2024-11-24 00:48:26,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36173 2837s 2024-11-24 00:48:26,282 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:26,283 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:26,283 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:26,283 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x52lqu7_ 2837s 2024-11-24 00:48:26,283 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:26,284 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34501. Reason: failure-to-start- 2837s 2024-11-24 00:48:26,285 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:26,285 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45443. Reason: failure-to-start- 2837s 2024-11-24 00:48:26,285 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:26,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36173': TLS handshake failed with remote 'tls://127.0.0.1:37666': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:26,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36173': TLS handshake failed with remote 'tls://127.0.0.1:37672': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:26,287 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:27,293 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:27,297 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44789 2837s 2024-11-24 00:48:27,297 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42049/status 2837s 2024-11-24 00:48:27,297 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:27,306 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35967 2837s 2024-11-24 00:48:27,307 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35967 2837s 2024-11-24 00:48:27,307 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:27,307 - distributed.worker - INFO - dashboard at: 127.0.0.1:36429 2837s 2024-11-24 00:48:27,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44789 2837s 2024-11-24 00:48:27,307 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:27,307 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:27,307 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:27,307 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p685uxtj 2837s 2024-11-24 00:48:27,307 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:27,308 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40239 2837s 2024-11-24 00:48:27,308 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40239 2837s 2024-11-24 00:48:27,308 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:27,308 - distributed.worker - INFO - dashboard at: 127.0.0.1:37083 2837s 2024-11-24 00:48:27,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44789 2837s 2024-11-24 00:48:27,308 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:27,309 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:27,309 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:27,309 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-di6_5nck 2837s 2024-11-24 00:48:27,309 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:27,309 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35967. Reason: failure-to-start- 2837s 2024-11-24 00:48:27,309 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:27,310 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40239. Reason: failure-to-start- 2837s 2024-11-24 00:48:27,310 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:27,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44789': TLS handshake failed with remote 'tls://127.0.0.1:52852': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:27,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44789': TLS handshake failed with remote 'tls://127.0.0.1:52860': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:27,312 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:28,316 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:28,320 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39137 2837s 2024-11-24 00:48:28,321 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41013/status 2837s 2024-11-24 00:48:28,321 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:28,332 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40109 2837s 2024-11-24 00:48:28,332 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40109 2837s 2024-11-24 00:48:28,332 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:28,332 - distributed.worker - INFO - dashboard at: 127.0.0.1:41041 2837s 2024-11-24 00:48:28,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39137 2837s 2024-11-24 00:48:28,333 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:28,333 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:28,333 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:28,333 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-30c5yoyo 2837s 2024-11-24 00:48:28,333 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:28,334 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32839 2837s 2024-11-24 00:48:28,334 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32839 2837s 2024-11-24 00:48:28,334 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:28,334 - distributed.worker - INFO - dashboard at: 127.0.0.1:34707 2837s 2024-11-24 00:48:28,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39137 2837s 2024-11-24 00:48:28,335 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:28,335 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:28,335 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:28,335 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pwllun73 2837s 2024-11-24 00:48:28,335 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:28,335 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40109. Reason: failure-to-start- 2837s 2024-11-24 00:48:28,336 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:28,336 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32839. Reason: failure-to-start- 2837s 2024-11-24 00:48:28,336 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:28,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39137': TLS handshake failed with remote 'tls://127.0.0.1:41416': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:28,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39137': TLS handshake failed with remote 'tls://127.0.0.1:41432': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:28,338 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:48:29,343 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:29,347 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44805 2837s 2024-11-24 00:48:29,348 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42687/status 2837s 2024-11-24 00:48:29,348 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:29,358 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43861 2837s 2024-11-24 00:48:29,358 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43861 2837s 2024-11-24 00:48:29,358 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:48:29,358 - distributed.worker - INFO - dashboard at: 127.0.0.1:35233 2837s 2024-11-24 00:48:29,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44805 2837s 2024-11-24 00:48:29,358 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:29,358 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:48:29,358 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:29,358 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mnfn2a_2 2837s 2024-11-24 00:48:29,358 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:29,361 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41657 2837s 2024-11-24 00:48:29,361 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41657 2837s 2024-11-24 00:48:29,361 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:48:29,361 - distributed.worker - INFO - dashboard at: 127.0.0.1:33659 2837s 2024-11-24 00:48:29,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44805 2837s 2024-11-24 00:48:29,361 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:29,361 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:48:29,361 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:48:29,361 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ft2l9jno 2837s 2024-11-24 00:48:29,361 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:48:29,362 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43861. Reason: failure-to-start- 2837s 2024-11-24 00:48:29,362 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:29,362 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41657. Reason: failure-to-start- 2837s 2024-11-24 00:48:29,362 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:48:29,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44805': TLS handshake failed with remote 'tls://127.0.0.1:50736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:29,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44805': TLS handshake failed with remote 'tls://127.0.0.1:50750': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:29,364 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s __________________________________ test_nanny __________________________________ 2837s 2837s fut = , timeout = 0 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s /usr/lib/python3/dist-packages/distributed/core.py:1620: in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s /usr/lib/python3/dist-packages/distributed/core.py:1564: in _connect 2837s comm = await connect( 2837s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2837s comm = await wait_for( 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2837s return await fut 2837s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 2837s stream = await self.client.connect( 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s host = '127.0.0.1', port = 37269, af = 2837s ssl_options = 2837s max_buffer_size = 4151066624.0, source_ip = None, source_port = None 2837s timeout = None 2837s 2837s async def connect( 2837s self, 2837s host: str, 2837s port: int, 2837s af: socket.AddressFamily = socket.AF_UNSPEC, 2837s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 2837s max_buffer_size: Optional[int] = None, 2837s source_ip: Optional[str] = None, 2837s source_port: Optional[int] = None, 2837s timeout: Optional[Union[float, datetime.timedelta]] = None, 2837s ) -> IOStream: 2837s """Connect to the given host and port. 2837s 2837s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 2837s ``ssl_options`` is not None). 2837s 2837s Using the ``source_ip`` kwarg, one can specify the source 2837s IP address to use when establishing the connection. 2837s In case the user needs to resolve and 2837s use a specific interface, it has to be handled outside 2837s of Tornado as this depends very much on the platform. 2837s 2837s Raises `TimeoutError` if the input future does not complete before 2837s ``timeout``, which may be specified in any form allowed by 2837s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 2837s relative to `.IOLoop.time`) 2837s 2837s Similarly, when the user requires a certain source port, it can 2837s be specified using the ``source_port`` arg. 2837s 2837s .. versionchanged:: 4.5 2837s Added the ``source_ip`` and ``source_port`` arguments. 2837s 2837s .. versionchanged:: 5.0 2837s Added the ``timeout`` argument. 2837s """ 2837s if timeout is not None: 2837s if isinstance(timeout, numbers.Real): 2837s timeout = IOLoop.current().time() + timeout 2837s elif isinstance(timeout, datetime.timedelta): 2837s timeout = IOLoop.current().time() + timeout.total_seconds() 2837s else: 2837s raise TypeError("Unsupported timeout %r" % timeout) 2837s if timeout is not None: 2837s addrinfo = await gen.with_timeout( 2837s timeout, self.resolver.resolve(host, port, af) 2837s ) 2837s else: 2837s addrinfo = await self.resolver.resolve(host, port, af) 2837s connector = _Connector( 2837s addrinfo, 2837s functools.partial( 2837s self._create_stream, 2837s max_buffer_size, 2837s source_ip=source_ip, 2837s source_port=source_port, 2837s ), 2837s ) 2837s > af, addr, stream = await connector.start(connect_timeout=timeout) 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s > await wait_for(self.start_unsafe(), timeout=timeout) 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:664: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s @contextlib.asynccontextmanager 2837s async def _cluster_factory(): 2837s workers = [] 2837s s = None 2837s try: 2837s for _ in range(60): 2837s try: 2837s > s, ws = await start_cluster( 2837s nthreads, 2837s scheduler, 2837s security=security, 2837s Worker=Worker, 2837s scheduler_kwargs=scheduler_kwargs, 2837s worker_kwargs=merge( 2837s {"death_timeout": min(15, int(deadline.remaining))}, 2837s worker_kwargs, 2837s ), 2837s ) 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 2837s await asyncio.gather(*workers) 2837s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 2837s return await awaitable 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s except asyncio.TimeoutError as exc: 2837s await _close_on_failure(exc) 2837s > raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s E TimeoutError: Nanny start timed out after 0s. 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s fut = ._..test_func..async_fn at 0xe63f7717a650> 2837s timeout = 60 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 2837s _cluster_factory() as (s, workers), 2837s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 2837s return await anext(self.gen) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 2837s await asyncio.sleep(1) 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s delay = 1, result = None 2837s 2837s async def sleep(delay, result=None): 2837s """Coroutine that completes after a given time (in seconds).""" 2837s if delay <= 0: 2837s await __sleep0() 2837s return result 2837s 2837s if math.isnan(delay): 2837s raise ValueError("Invalid delay: NaN (not a number)") 2837s 2837s loop = events.get_running_loop() 2837s future = loop.create_future() 2837s h = loop.call_later(delay, 2837s futures._set_result_unless_cancelled, 2837s future, result) 2837s try: 2837s > return await future 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s args = (), kwds = {} 2837s 2837s @wraps(func) 2837s def inner(*args, **kwds): 2837s with self._recreate_cm(): 2837s > return func(*args, **kwds) 2837s 2837s /usr/lib/python3.13/contextlib.py:85: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3.13/contextlib.py:85: in inner 2837s return func(*args, **kwds) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 2837s return _run_and_close_tornado(async_fn_outer) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 2837s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 2837s /usr/lib/python3.13/asyncio/runners.py:194: in run 2837s return runner.run(main) 2837s /usr/lib/python3.13/asyncio/runners.py:118: in run 2837s return self._loop.run_until_complete(task) 2837s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 2837s return future.result() 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 2837s return await async_fn(*args, **kwargs) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 2837s return await utils_wait_for(async_fn(), timeout=timeout * 2) 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s ----------------------------- Captured stderr call ----------------------------- 2837s 2024-11-24 00:48:30,020 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:30,024 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35193 2837s 2024-11-24 00:48:30,024 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33511/status 2837s 2024-11-24 00:48:30,025 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:30,041 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40563'. Reason: failure-to-start- 2837s 2024-11-24 00:48:30,042 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44719'. Reason: failure-to-start- 2837s 2024-11-24 00:48:30,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35193': TLS handshake failed with remote 'tls://127.0.0.1:41766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:30,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35193': TLS handshake failed with remote 'tls://127.0.0.1:41772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:30,042 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:31,048 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:31,052 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44505 2837s 2024-11-24 00:48:31,052 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33553/status 2837s 2024-11-24 00:48:31,052 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:31,070 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44047'. Reason: failure-to-start- 2837s 2024-11-24 00:48:31,070 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36599'. Reason: failure-to-start- 2837s 2024-11-24 00:48:31,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:57146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:31,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:57148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:31,071 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:32,076 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:32,080 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38711 2837s 2024-11-24 00:48:32,080 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35523/status 2837s 2024-11-24 00:48:32,081 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:32,097 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36399'. Reason: failure-to-start- 2837s 2024-11-24 00:48:32,098 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34233'. Reason: failure-to-start- 2837s 2024-11-24 00:48:32,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38711': TLS handshake failed with remote 'tls://127.0.0.1:42134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:32,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38711': TLS handshake failed with remote 'tls://127.0.0.1:42150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:32,098 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:33,103 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:33,107 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39185 2837s 2024-11-24 00:48:33,107 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40191/status 2837s 2024-11-24 00:48:33,107 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:33,124 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46645'. Reason: failure-to-start- 2837s 2024-11-24 00:48:33,125 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40683'. Reason: failure-to-start- 2837s 2024-11-24 00:48:33,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39185': TLS handshake failed with remote 'tls://127.0.0.1:38516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:33,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39185': TLS handshake failed with remote 'tls://127.0.0.1:38524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:33,125 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:34,130 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:34,134 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44389 2837s 2024-11-24 00:48:34,134 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38111/status 2837s 2024-11-24 00:48:34,135 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:34,150 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41445'. Reason: failure-to-start- 2837s 2024-11-24 00:48:34,151 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46517'. Reason: failure-to-start- 2837s 2024-11-24 00:48:34,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44389': TLS handshake failed with remote 'tls://127.0.0.1:55370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:34,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44389': TLS handshake failed with remote 'tls://127.0.0.1:55376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:34,151 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:35,156 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:35,162 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33573 2837s 2024-11-24 00:48:35,162 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34235/status 2837s 2024-11-24 00:48:35,162 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:35,180 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43543'. Reason: failure-to-start- 2837s 2024-11-24 00:48:35,180 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34771'. Reason: failure-to-start- 2837s 2024-11-24 00:48:35,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33573': TLS handshake failed with remote 'tls://127.0.0.1:52944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:35,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33573': TLS handshake failed with remote 'tls://127.0.0.1:52952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:35,181 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:36,185 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:36,189 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39623 2837s 2024-11-24 00:48:36,189 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44865/status 2837s 2024-11-24 00:48:36,190 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:36,206 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36053'. Reason: failure-to-start- 2837s 2024-11-24 00:48:36,206 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40707'. Reason: failure-to-start- 2837s 2024-11-24 00:48:36,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:46712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:36,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:46724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:36,206 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:37,211 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:37,215 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42451 2837s 2024-11-24 00:48:37,215 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42447/status 2837s 2024-11-24 00:48:37,216 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:37,233 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36429'. Reason: failure-to-start- 2837s 2024-11-24 00:48:37,233 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41163'. Reason: failure-to-start- 2837s 2024-11-24 00:48:37,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42451': TLS handshake failed with remote 'tls://127.0.0.1:39878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:37,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42451': TLS handshake failed with remote 'tls://127.0.0.1:39882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:37,234 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:38,238 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:38,242 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37153 2837s 2024-11-24 00:48:38,242 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35535/status 2837s 2024-11-24 00:48:38,242 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:38,259 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37147'. Reason: failure-to-start- 2837s 2024-11-24 00:48:38,259 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38821'. Reason: failure-to-start- 2837s 2024-11-24 00:48:38,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37153': TLS handshake failed with remote 'tls://127.0.0.1:56762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:38,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37153': TLS handshake failed with remote 'tls://127.0.0.1:56774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:38,260 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:39,264 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:39,268 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35831 2837s 2024-11-24 00:48:39,269 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46261/status 2837s 2024-11-24 00:48:39,269 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:39,291 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34789'. Reason: failure-to-start- 2837s 2024-11-24 00:48:39,291 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45051'. Reason: failure-to-start- 2837s 2024-11-24 00:48:39,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35831': TLS handshake failed with remote 'tls://127.0.0.1:39980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:39,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35831': TLS handshake failed with remote 'tls://127.0.0.1:39988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:39,292 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:40,296 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:40,300 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33067 2837s 2024-11-24 00:48:40,301 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36399/status 2837s 2024-11-24 00:48:40,301 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:40,318 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45647'. Reason: failure-to-start- 2837s 2024-11-24 00:48:40,318 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44095'. Reason: failure-to-start- 2837s 2024-11-24 00:48:40,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33067': TLS handshake failed with remote 'tls://127.0.0.1:57540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:40,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33067': TLS handshake failed with remote 'tls://127.0.0.1:57552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:40,319 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:41,323 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:41,328 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42123 2837s 2024-11-24 00:48:41,328 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45305/status 2837s 2024-11-24 00:48:41,328 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:41,345 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46359'. Reason: failure-to-start- 2837s 2024-11-24 00:48:41,345 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36853'. Reason: failure-to-start- 2837s 2024-11-24 00:48:41,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42123': TLS handshake failed with remote 'tls://127.0.0.1:40836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:41,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42123': TLS handshake failed with remote 'tls://127.0.0.1:40850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:41,346 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:42,652 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:42,656 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36575 2837s 2024-11-24 00:48:42,656 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35527/status 2837s 2024-11-24 00:48:42,657 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:42,674 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42885'. Reason: failure-to-start- 2837s 2024-11-24 00:48:42,675 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45553'. Reason: failure-to-start- 2837s 2024-11-24 00:48:42,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36575': TLS handshake failed with remote 'tls://127.0.0.1:57228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:42,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36575': TLS handshake failed with remote 'tls://127.0.0.1:57244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:42,675 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:43,680 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:43,684 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46117 2837s 2024-11-24 00:48:43,685 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35823/status 2837s 2024-11-24 00:48:43,685 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:43,703 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42079'. Reason: failure-to-start- 2837s 2024-11-24 00:48:43,703 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34015'. Reason: failure-to-start- 2837s 2024-11-24 00:48:43,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46117': TLS handshake failed with remote 'tls://127.0.0.1:58136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:43,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46117': TLS handshake failed with remote 'tls://127.0.0.1:58142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:43,703 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:44,708 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:44,712 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32849 2837s 2024-11-24 00:48:44,712 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35795/status 2837s 2024-11-24 00:48:44,712 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:44,730 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35929'. Reason: failure-to-start- 2837s 2024-11-24 00:48:44,730 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40423'. Reason: failure-to-start- 2837s 2024-11-24 00:48:44,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32849': TLS handshake failed with remote 'tls://127.0.0.1:40828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:44,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32849': TLS handshake failed with remote 'tls://127.0.0.1:40842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:44,730 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:45,735 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:45,740 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37805 2837s 2024-11-24 00:48:45,740 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45767/status 2837s 2024-11-24 00:48:45,740 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:45,758 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43993'. Reason: failure-to-start- 2837s 2024-11-24 00:48:45,759 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33263'. Reason: failure-to-start- 2837s 2024-11-24 00:48:45,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37805': TLS handshake failed with remote 'tls://127.0.0.1:60342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:45,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37805': TLS handshake failed with remote 'tls://127.0.0.1:60344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:45,759 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:46,763 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:46,767 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41779 2837s 2024-11-24 00:48:46,767 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45295/status 2837s 2024-11-24 00:48:46,767 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:46,785 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33119'. Reason: failure-to-start- 2837s 2024-11-24 00:48:46,785 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41639'. Reason: failure-to-start- 2837s 2024-11-24 00:48:46,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:46,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:46,785 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:47,790 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:47,796 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43205 2837s 2024-11-24 00:48:47,796 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32869/status 2837s 2024-11-24 00:48:47,796 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:47,815 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44081'. Reason: failure-to-start- 2837s 2024-11-24 00:48:47,816 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36537'. Reason: failure-to-start- 2837s 2024-11-24 00:48:47,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43205': TLS handshake failed with remote 'tls://127.0.0.1:50680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:47,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43205': TLS handshake failed with remote 'tls://127.0.0.1:50692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:47,816 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:48,821 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:48,825 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45705 2837s 2024-11-24 00:48:48,825 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44665/status 2837s 2024-11-24 00:48:48,825 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:48,843 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46649'. Reason: failure-to-start- 2837s 2024-11-24 00:48:48,843 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43043'. Reason: failure-to-start- 2837s 2024-11-24 00:48:48,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45705': TLS handshake failed with remote 'tls://127.0.0.1:44518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:48,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45705': TLS handshake failed with remote 'tls://127.0.0.1:44528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:48,844 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:49,850 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:49,854 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34081 2837s 2024-11-24 00:48:49,854 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45939/status 2837s 2024-11-24 00:48:49,854 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:49,872 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38683'. Reason: failure-to-start- 2837s 2024-11-24 00:48:49,872 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36217'. Reason: failure-to-start- 2837s 2024-11-24 00:48:49,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34081': TLS handshake failed with remote 'tls://127.0.0.1:51640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:49,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34081': TLS handshake failed with remote 'tls://127.0.0.1:51642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:49,873 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:50,878 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:50,882 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42975 2837s 2024-11-24 00:48:50,882 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42893/status 2837s 2024-11-24 00:48:50,882 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:50,900 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41883'. Reason: failure-to-start- 2837s 2024-11-24 00:48:50,901 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37325'. Reason: failure-to-start- 2837s 2024-11-24 00:48:50,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42975': TLS handshake failed with remote 'tls://127.0.0.1:55110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:50,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42975': TLS handshake failed with remote 'tls://127.0.0.1:55112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:50,901 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:51,906 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:51,910 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41701 2837s 2024-11-24 00:48:51,910 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33829/status 2837s 2024-11-24 00:48:51,910 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:51,928 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38313'. Reason: failure-to-start- 2837s 2024-11-24 00:48:51,929 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36253'. Reason: failure-to-start- 2837s 2024-11-24 00:48:51,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41701': TLS handshake failed with remote 'tls://127.0.0.1:45848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:51,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41701': TLS handshake failed with remote 'tls://127.0.0.1:45860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:51,929 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:52,934 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:52,938 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43537 2837s 2024-11-24 00:48:52,938 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44571/status 2837s 2024-11-24 00:48:52,938 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:52,958 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35447'. Reason: failure-to-start- 2837s 2024-11-24 00:48:52,958 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42851'. Reason: failure-to-start- 2837s 2024-11-24 00:48:52,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43537': TLS handshake failed with remote 'tls://127.0.0.1:44854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:52,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43537': TLS handshake failed with remote 'tls://127.0.0.1:44860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:52,959 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:53,964 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:53,968 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41847 2837s 2024-11-24 00:48:53,968 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45973/status 2837s 2024-11-24 00:48:53,968 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:53,987 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45841'. Reason: failure-to-start- 2837s 2024-11-24 00:48:53,987 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34355'. Reason: failure-to-start- 2837s 2024-11-24 00:48:53,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41847': TLS handshake failed with remote 'tls://127.0.0.1:54642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:53,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41847': TLS handshake failed with remote 'tls://127.0.0.1:54648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:53,988 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:54,992 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:54,996 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33355 2837s 2024-11-24 00:48:54,996 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37911/status 2837s 2024-11-24 00:48:54,997 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:55,017 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44369'. Reason: failure-to-start- 2837s 2024-11-24 00:48:55,017 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37051'. Reason: failure-to-start- 2837s 2024-11-24 00:48:55,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33355': TLS handshake failed with remote 'tls://127.0.0.1:47384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:55,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33355': TLS handshake failed with remote 'tls://127.0.0.1:47392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:55,018 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:56,022 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:56,026 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39661 2837s 2024-11-24 00:48:56,026 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38715/status 2837s 2024-11-24 00:48:56,027 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:56,046 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33247'. Reason: failure-to-start- 2837s 2024-11-24 00:48:56,046 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33869'. Reason: failure-to-start- 2837s 2024-11-24 00:48:56,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39661': TLS handshake failed with remote 'tls://127.0.0.1:40536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:56,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39661': TLS handshake failed with remote 'tls://127.0.0.1:40548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:56,047 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:57,051 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:57,056 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38611 2837s 2024-11-24 00:48:57,057 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44961/status 2837s 2024-11-24 00:48:57,057 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:57,075 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34433'. Reason: failure-to-start- 2837s 2024-11-24 00:48:57,076 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36335'. Reason: failure-to-start- 2837s 2024-11-24 00:48:57,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38611': TLS handshake failed with remote 'tls://127.0.0.1:58082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:57,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38611': TLS handshake failed with remote 'tls://127.0.0.1:58098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:57,076 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:58,081 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:58,084 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40357 2837s 2024-11-24 00:48:58,085 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45253/status 2837s 2024-11-24 00:48:58,085 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:58,103 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34035'. Reason: failure-to-start- 2837s 2024-11-24 00:48:58,103 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36337'. Reason: failure-to-start- 2837s 2024-11-24 00:48:58,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40357': TLS handshake failed with remote 'tls://127.0.0.1:58584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:58,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40357': TLS handshake failed with remote 'tls://127.0.0.1:58598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:48:58,104 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:48:59,110 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:48:59,114 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33483 2837s 2024-11-24 00:48:59,114 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41545/status 2837s 2024-11-24 00:48:59,115 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:48:59,123 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45793'. Reason: failure-to-start- 2837s 2024-11-24 00:48:59,123 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41223'. Reason: failure-to-start- 2837s 2024-11-24 00:48:59,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33483': TLS handshake failed with remote 'tls://127.0.0.1:49322': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:59,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33483': TLS handshake failed with remote 'tls://127.0.0.1:49324': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:48:59,124 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:00,129 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:00,132 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36161 2837s 2024-11-24 00:49:00,133 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35429/status 2837s 2024-11-24 00:49:00,133 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:00,141 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37575'. Reason: failure-to-start- 2837s 2024-11-24 00:49:00,141 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35095'. Reason: failure-to-start- 2837s 2024-11-24 00:49:00,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36161': TLS handshake failed with remote 'tls://127.0.0.1:49062': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:00,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36161': TLS handshake failed with remote 'tls://127.0.0.1:49078': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:00,142 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:01,147 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:01,151 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36433 2837s 2024-11-24 00:49:01,151 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42711/status 2837s 2024-11-24 00:49:01,152 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:01,159 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38095'. Reason: failure-to-start- 2837s 2024-11-24 00:49:01,159 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43525'. Reason: failure-to-start- 2837s 2024-11-24 00:49:01,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36433': TLS handshake failed with remote 'tls://127.0.0.1:43596': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:01,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36433': TLS handshake failed with remote 'tls://127.0.0.1:43600': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:01,161 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:02,166 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:02,170 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40797 2837s 2024-11-24 00:49:02,170 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41593/status 2837s 2024-11-24 00:49:02,170 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:02,177 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34461'. Reason: failure-to-start- 2837s 2024-11-24 00:49:02,177 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44945'. Reason: failure-to-start- 2837s 2024-11-24 00:49:02,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40797': TLS handshake failed with remote 'tls://127.0.0.1:58800': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:02,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40797': TLS handshake failed with remote 'tls://127.0.0.1:58816': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:02,178 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:03,182 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:03,186 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40871 2837s 2024-11-24 00:49:03,186 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45117/status 2837s 2024-11-24 00:49:03,186 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:03,195 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34805'. Reason: failure-to-start- 2837s 2024-11-24 00:49:03,196 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37187'. Reason: failure-to-start- 2837s 2024-11-24 00:49:03,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40871': TLS handshake failed with remote 'tls://127.0.0.1:55416': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:03,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40871': TLS handshake failed with remote 'tls://127.0.0.1:55422': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:03,196 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:04,201 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:04,205 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37671 2837s 2024-11-24 00:49:04,205 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42803/status 2837s 2024-11-24 00:49:04,206 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:04,222 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38835'. Reason: failure-to-start- 2837s 2024-11-24 00:49:04,222 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37659'. Reason: failure-to-start- 2837s 2024-11-24 00:49:04,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37671': TLS handshake failed with remote 'tls://127.0.0.1:57102': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:04,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37671': TLS handshake failed with remote 'tls://127.0.0.1:57114': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:04,224 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:05,229 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:05,235 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33373 2837s 2024-11-24 00:49:05,235 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41671/status 2837s 2024-11-24 00:49:05,235 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:05,243 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40401'. Reason: failure-to-start- 2837s 2024-11-24 00:49:05,243 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46487'. Reason: failure-to-start- 2837s 2024-11-24 00:49:05,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33373': TLS handshake failed with remote 'tls://127.0.0.1:56166': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:05,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33373': TLS handshake failed with remote 'tls://127.0.0.1:56168': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:05,246 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:06,250 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:06,254 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40733 2837s 2024-11-24 00:49:06,254 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44897/status 2837s 2024-11-24 00:49:06,254 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:06,262 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45655'. Reason: failure-to-start- 2837s 2024-11-24 00:49:06,263 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44973'. Reason: failure-to-start- 2837s 2024-11-24 00:49:06,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40733': TLS handshake failed with remote 'tls://127.0.0.1:46554': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:06,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40733': TLS handshake failed with remote 'tls://127.0.0.1:46564': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:06,263 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:07,268 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:07,271 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34541 2837s 2024-11-24 00:49:07,272 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45675/status 2837s 2024-11-24 00:49:07,272 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:07,280 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43671'. Reason: failure-to-start- 2837s 2024-11-24 00:49:07,281 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38939'. Reason: failure-to-start- 2837s 2024-11-24 00:49:07,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34541': TLS handshake failed with remote 'tls://127.0.0.1:53192': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:07,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34541': TLS handshake failed with remote 'tls://127.0.0.1:53198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:07,281 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:08,286 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:08,290 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37589 2837s 2024-11-24 00:49:08,290 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43003/status 2837s 2024-11-24 00:49:08,290 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:08,300 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34963'. Reason: failure-to-start- 2837s 2024-11-24 00:49:08,300 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38747'. Reason: failure-to-start- 2837s 2024-11-24 00:49:08,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:59744': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:08,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:59758': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:08,301 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:09,306 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:09,310 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37833 2837s 2024-11-24 00:49:09,310 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45475/status 2837s 2024-11-24 00:49:09,310 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:09,318 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33717'. Reason: failure-to-start- 2837s 2024-11-24 00:49:09,318 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34323'. Reason: failure-to-start- 2837s 2024-11-24 00:49:09,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37833': TLS handshake failed with remote 'tls://127.0.0.1:45148': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:09,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37833': TLS handshake failed with remote 'tls://127.0.0.1:45154': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:09,319 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:10,323 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:10,329 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38703 2837s 2024-11-24 00:49:10,329 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42385/status 2837s 2024-11-24 00:49:10,329 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:10,339 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34015'. Reason: failure-to-start- 2837s 2024-11-24 00:49:10,339 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40327'. Reason: failure-to-start- 2837s 2024-11-24 00:49:10,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38703': TLS handshake failed with remote 'tls://127.0.0.1:39282': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:10,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38703': TLS handshake failed with remote 'tls://127.0.0.1:39292': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:10,340 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:11,345 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:11,349 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40517 2837s 2024-11-24 00:49:11,349 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45019/status 2837s 2024-11-24 00:49:11,349 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:11,357 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41953'. Reason: failure-to-start- 2837s 2024-11-24 00:49:11,357 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38943'. Reason: failure-to-start- 2837s 2024-11-24 00:49:11,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40517': TLS handshake failed with remote 'tls://127.0.0.1:40940': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:11,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40517': TLS handshake failed with remote 'tls://127.0.0.1:40954': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:11,359 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:12,366 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:12,370 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40097 2837s 2024-11-24 00:49:12,370 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33281/status 2837s 2024-11-24 00:49:12,370 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:12,378 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43089'. Reason: failure-to-start- 2837s 2024-11-24 00:49:12,378 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36027'. Reason: failure-to-start- 2837s 2024-11-24 00:49:12,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40097': TLS handshake failed with remote 'tls://127.0.0.1:57166': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:12,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40097': TLS handshake failed with remote 'tls://127.0.0.1:57180': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:12,379 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:13,384 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:13,388 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35625 2837s 2024-11-24 00:49:13,388 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37131/status 2837s 2024-11-24 00:49:13,388 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:13,397 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41045'. Reason: failure-to-start- 2837s 2024-11-24 00:49:13,397 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42081'. Reason: failure-to-start- 2837s 2024-11-24 00:49:13,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35625': TLS handshake failed with remote 'tls://127.0.0.1:46836': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:13,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35625': TLS handshake failed with remote 'tls://127.0.0.1:46838': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:13,398 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:14,402 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:14,406 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42365 2837s 2024-11-24 00:49:14,406 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39923/status 2837s 2024-11-24 00:49:14,406 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:14,414 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43821'. Reason: failure-to-start- 2837s 2024-11-24 00:49:14,415 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36609'. Reason: failure-to-start- 2837s 2024-11-24 00:49:14,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42365': TLS handshake failed with remote 'tls://127.0.0.1:52200': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:14,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42365': TLS handshake failed with remote 'tls://127.0.0.1:52210': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:14,415 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:15,420 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:15,424 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37391 2837s 2024-11-24 00:49:15,424 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43645/status 2837s 2024-11-24 00:49:15,425 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:15,434 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44767'. Reason: failure-to-start- 2837s 2024-11-24 00:49:15,434 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43199'. Reason: failure-to-start- 2837s 2024-11-24 00:49:15,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:47162': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:15,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:47176': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:15,435 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:16,439 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:16,443 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33083 2837s 2024-11-24 00:49:16,444 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37601/status 2837s 2024-11-24 00:49:16,444 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:16,453 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38777'. Reason: failure-to-start- 2837s 2024-11-24 00:49:16,453 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46657'. Reason: failure-to-start- 2837s 2024-11-24 00:49:16,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33083': TLS handshake failed with remote 'tls://127.0.0.1:37786': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:16,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33083': TLS handshake failed with remote 'tls://127.0.0.1:37794': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:16,454 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:17,458 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:17,463 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40925 2837s 2024-11-24 00:49:17,463 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46299/status 2837s 2024-11-24 00:49:17,463 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:17,473 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39133'. Reason: failure-to-start- 2837s 2024-11-24 00:49:17,474 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38801'. Reason: failure-to-start- 2837s 2024-11-24 00:49:17,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40925': TLS handshake failed with remote 'tls://127.0.0.1:52840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:17,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40925': TLS handshake failed with remote 'tls://127.0.0.1:52850': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:17,475 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:18,480 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:18,484 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39169 2837s 2024-11-24 00:49:18,484 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44715/status 2837s 2024-11-24 00:49:18,484 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:18,492 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38445'. Reason: failure-to-start- 2837s 2024-11-24 00:49:18,492 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41501'. Reason: failure-to-start- 2837s 2024-11-24 00:49:18,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39169': TLS handshake failed with remote 'tls://127.0.0.1:47190': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:18,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39169': TLS handshake failed with remote 'tls://127.0.0.1:47198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:18,493 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:19,498 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:19,501 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42673 2837s 2024-11-24 00:49:19,502 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39245/status 2837s 2024-11-24 00:49:19,502 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:19,511 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39037'. Reason: failure-to-start- 2837s 2024-11-24 00:49:19,512 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40697'. Reason: failure-to-start- 2837s 2024-11-24 00:49:19,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42673': TLS handshake failed with remote 'tls://127.0.0.1:53326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:19,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42673': TLS handshake failed with remote 'tls://127.0.0.1:53342': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:19,512 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:20,517 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:20,520 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36013 2837s 2024-11-24 00:49:20,521 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37605/status 2837s 2024-11-24 00:49:20,521 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:20,529 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45903'. Reason: failure-to-start- 2837s 2024-11-24 00:49:20,529 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44173'. Reason: failure-to-start- 2837s 2024-11-24 00:49:20,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36013': TLS handshake failed with remote 'tls://127.0.0.1:34760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:20,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36013': TLS handshake failed with remote 'tls://127.0.0.1:34776': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:20,530 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:21,535 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:21,539 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41187 2837s 2024-11-24 00:49:21,539 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42353/status 2837s 2024-11-24 00:49:21,539 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:21,548 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41987'. Reason: failure-to-start- 2837s 2024-11-24 00:49:21,549 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38529'. Reason: failure-to-start- 2837s 2024-11-24 00:49:21,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41187': TLS handshake failed with remote 'tls://127.0.0.1:53782': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:21,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41187': TLS handshake failed with remote 'tls://127.0.0.1:53790': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:21,549 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:22,553 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:22,557 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34063 2837s 2024-11-24 00:49:22,557 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40007/status 2837s 2024-11-24 00:49:22,558 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:22,567 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35025'. Reason: failure-to-start- 2837s 2024-11-24 00:49:22,567 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46125'. Reason: failure-to-start- 2837s 2024-11-24 00:49:22,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34016': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:22,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34018': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:22,567 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:23,571 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:23,576 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40991 2837s 2024-11-24 00:49:23,576 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38329/status 2837s 2024-11-24 00:49:23,576 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:23,587 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35167'. Reason: failure-to-start- 2837s 2024-11-24 00:49:23,587 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33439'. Reason: failure-to-start- 2837s 2024-11-24 00:49:23,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40991': TLS handshake failed with remote 'tls://127.0.0.1:39830': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:23,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40991': TLS handshake failed with remote 'tls://127.0.0.1:39840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:23,589 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:24,593 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:24,597 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45831 2837s 2024-11-24 00:49:24,598 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33723/status 2837s 2024-11-24 00:49:24,598 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:24,606 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40449'. Reason: failure-to-start- 2837s 2024-11-24 00:49:24,606 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37537'. Reason: failure-to-start- 2837s 2024-11-24 00:49:24,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45831': TLS handshake failed with remote 'tls://127.0.0.1:49982': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:24,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45831': TLS handshake failed with remote 'tls://127.0.0.1:49984': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:24,607 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:25,611 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:25,616 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33701 2837s 2024-11-24 00:49:25,616 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44141/status 2837s 2024-11-24 00:49:25,616 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:25,627 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42031'. Reason: failure-to-start- 2837s 2024-11-24 00:49:25,627 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34687'. Reason: failure-to-start- 2837s 2024-11-24 00:49:25,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33701': TLS handshake failed with remote 'tls://127.0.0.1:43622': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:25,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33701': TLS handshake failed with remote 'tls://127.0.0.1:43630': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:25,628 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:26,632 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:26,636 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44821 2837s 2024-11-24 00:49:26,637 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40543/status 2837s 2024-11-24 00:49:26,637 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:26,646 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37191'. Reason: failure-to-start- 2837s 2024-11-24 00:49:26,646 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40901'. Reason: failure-to-start- 2837s 2024-11-24 00:49:26,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44821': TLS handshake failed with remote 'tls://127.0.0.1:37384': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:26,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44821': TLS handshake failed with remote 'tls://127.0.0.1:37398': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:26,646 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:27,650 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:27,654 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40453 2837s 2024-11-24 00:49:27,655 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43251/status 2837s 2024-11-24 00:49:27,655 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:27,677 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41441'. Reason: failure-to-start- 2837s 2024-11-24 00:49:27,678 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45029'. Reason: failure-to-start- 2837s 2024-11-24 00:49:27,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40453': TLS handshake failed with remote 'tls://127.0.0.1:40052': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:27,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40453': TLS handshake failed with remote 'tls://127.0.0.1:40060': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:27,678 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:28,683 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:28,688 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43735 2837s 2024-11-24 00:49:28,688 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34643/status 2837s 2024-11-24 00:49:28,688 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:28,700 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43947'. Reason: failure-to-start- 2837s 2024-11-24 00:49:28,700 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34291'. Reason: failure-to-start- 2837s 2024-11-24 00:49:28,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43735': TLS handshake failed with remote 'tls://127.0.0.1:42792': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:28,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43735': TLS handshake failed with remote 'tls://127.0.0.1:42806': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:28,701 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:49:29,705 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:29,709 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37269 2837s 2024-11-24 00:49:29,709 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45801/status 2837s 2024-11-24 00:49:29,710 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:29,724 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42387'. Reason: failure-to-start- 2837s 2024-11-24 00:49:29,724 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35839'. Reason: failure-to-start- 2837s 2024-11-24 00:49:29,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37269': TLS handshake failed with remote 'tls://127.0.0.1:49784': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:29,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37269': TLS handshake failed with remote 'tls://127.0.0.1:49794': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:49:29,725 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s ________________________________ test_rebalance ________________________________ 2837s 2837s fut = , timeout = 0 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 2837s await self._register_with_scheduler() 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2837s comm = await wait_for( 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2837s return await fut 2837s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 2837s stream = await self.client.connect( 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s host = '127.0.0.1', port = 45181, af = 2837s ssl_options = 2837s max_buffer_size = 4151066624.0, source_ip = None, source_port = None 2837s timeout = None 2837s 2837s async def connect( 2837s self, 2837s host: str, 2837s port: int, 2837s af: socket.AddressFamily = socket.AF_UNSPEC, 2837s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 2837s max_buffer_size: Optional[int] = None, 2837s source_ip: Optional[str] = None, 2837s source_port: Optional[int] = None, 2837s timeout: Optional[Union[float, datetime.timedelta]] = None, 2837s ) -> IOStream: 2837s """Connect to the given host and port. 2837s 2837s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 2837s ``ssl_options`` is not None). 2837s 2837s Using the ``source_ip`` kwarg, one can specify the source 2837s IP address to use when establishing the connection. 2837s In case the user needs to resolve and 2837s use a specific interface, it has to be handled outside 2837s of Tornado as this depends very much on the platform. 2837s 2837s Raises `TimeoutError` if the input future does not complete before 2837s ``timeout``, which may be specified in any form allowed by 2837s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 2837s relative to `.IOLoop.time`) 2837s 2837s Similarly, when the user requires a certain source port, it can 2837s be specified using the ``source_port`` arg. 2837s 2837s .. versionchanged:: 4.5 2837s Added the ``source_ip`` and ``source_port`` arguments. 2837s 2837s .. versionchanged:: 5.0 2837s Added the ``timeout`` argument. 2837s """ 2837s if timeout is not None: 2837s if isinstance(timeout, numbers.Real): 2837s timeout = IOLoop.current().time() + timeout 2837s elif isinstance(timeout, datetime.timedelta): 2837s timeout = IOLoop.current().time() + timeout.total_seconds() 2837s else: 2837s raise TypeError("Unsupported timeout %r" % timeout) 2837s if timeout is not None: 2837s addrinfo = await gen.with_timeout( 2837s timeout, self.resolver.resolve(host, port, af) 2837s ) 2837s else: 2837s addrinfo = await self.resolver.resolve(host, port, af) 2837s connector = _Connector( 2837s addrinfo, 2837s functools.partial( 2837s self._create_stream, 2837s max_buffer_size, 2837s source_ip=source_ip, 2837s source_port=source_port, 2837s ), 2837s ) 2837s > af, addr, stream = await connector.start(connect_timeout=timeout) 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s > await wait_for(self.start_unsafe(), timeout=timeout) 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:664: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s @contextlib.asynccontextmanager 2837s async def _cluster_factory(): 2837s workers = [] 2837s s = None 2837s try: 2837s for _ in range(60): 2837s try: 2837s > s, ws = await start_cluster( 2837s nthreads, 2837s scheduler, 2837s security=security, 2837s Worker=Worker, 2837s scheduler_kwargs=scheduler_kwargs, 2837s worker_kwargs=merge( 2837s {"death_timeout": min(15, int(deadline.remaining))}, 2837s worker_kwargs, 2837s ), 2837s ) 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 2837s await asyncio.gather(*workers) 2837s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 2837s return await awaitable 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s except asyncio.TimeoutError as exc: 2837s await _close_on_failure(exc) 2837s > raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s E TimeoutError: Worker start timed out after 0s. 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s fut = ._..test_func..async_fn at 0xe63f7717b130> 2837s timeout = 60 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 2837s _cluster_factory() as (s, workers), 2837s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 2837s return await anext(self.gen) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 2837s await asyncio.sleep(1) 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s delay = 1, result = None 2837s 2837s async def sleep(delay, result=None): 2837s """Coroutine that completes after a given time (in seconds).""" 2837s if delay <= 0: 2837s await __sleep0() 2837s return result 2837s 2837s if math.isnan(delay): 2837s raise ValueError("Invalid delay: NaN (not a number)") 2837s 2837s loop = events.get_running_loop() 2837s future = loop.create_future() 2837s h = loop.call_later(delay, 2837s futures._set_result_unless_cancelled, 2837s future, result) 2837s try: 2837s > return await future 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s args = (), kwds = {} 2837s 2837s @wraps(func) 2837s def inner(*args, **kwds): 2837s with self._recreate_cm(): 2837s > return func(*args, **kwds) 2837s 2837s /usr/lib/python3.13/contextlib.py:85: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3.13/contextlib.py:85: in inner 2837s return func(*args, **kwds) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 2837s return _run_and_close_tornado(async_fn_outer) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 2837s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 2837s /usr/lib/python3.13/asyncio/runners.py:194: in run 2837s return runner.run(main) 2837s /usr/lib/python3.13/asyncio/runners.py:118: in run 2837s return self._loop.run_until_complete(task) 2837s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 2837s return future.result() 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 2837s return await async_fn(*args, **kwargs) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 2837s return await utils_wait_for(async_fn(), timeout=timeout * 2) 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s ----------------------------- Captured stderr call ----------------------------- 2837s 2024-11-24 00:49:30,441 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:30,445 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:30,445 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37797/status 2837s 2024-11-24 00:49:30,445 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:30,454 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40163 2837s 2024-11-24 00:49:30,454 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40163 2837s 2024-11-24 00:49:30,454 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:49:30,454 - distributed.worker - INFO - dashboard at: 127.0.0.1:37203 2837s 2024-11-24 00:49:30,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:30,454 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:49:30,454 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:49:30,455 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:49:30,455 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3b2amokz 2837s 2024-11-24 00:49:30,455 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:49:30,456 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33343 2837s 2024-11-24 00:49:30,456 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33343 2837s 2024-11-24 00:49:30,456 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:49:30,456 - distributed.worker - INFO - dashboard at: 127.0.0.1:34011 2837s 2024-11-24 00:49:30,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:30,456 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:49:30,456 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:49:30,456 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:49:30,456 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x8j970xe 2837s 2024-11-24 00:49:30,456 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:49:30,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:30,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:30,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:30,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:30,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:30,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:30,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:30,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:30,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:30,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:30,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:30,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:30,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:30,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:30,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:30,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:30,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:30,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:30,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:30,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:31,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:31,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:32,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:32,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:33,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:33,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:34,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:34,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:55990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:35,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:35,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:36,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:36,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:37,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:37,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:38,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:38,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:39,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:39,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:40,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:40,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:46984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:41,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:41,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:42,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:42,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:43,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:43,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:44,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:44,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:45,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:45,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:45,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:45,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:45,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:45,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:45,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:45,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:47702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:45,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:45,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:45,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:36134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:45,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:36146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:45,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:45,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38643 2837s 2024-11-24 00:49:45,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:36162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:45,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38643': TLS handshake failed with remote 'tls://127.0.0.1:36164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:45,453 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40163. Reason: failure-to-start- 2837s 2024-11-24 00:49:45,453 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:49:45,454 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 15s. 2837s 2024-11-24 00:49:45,458 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33343. Reason: failure-to-start- 2837s 2024-11-24 00:49:45,458 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:49:46,460 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:49:46,464 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:46,465 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44591/status 2837s 2024-11-24 00:49:46,465 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:49:46,474 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33315 2837s 2024-11-24 00:49:46,474 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33315 2837s 2024-11-24 00:49:46,474 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:49:46,474 - distributed.worker - INFO - dashboard at: 127.0.0.1:39189 2837s 2024-11-24 00:49:46,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:46,474 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:49:46,474 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:49:46,474 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:49:46,474 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9s8yc2lu 2837s 2024-11-24 00:49:46,474 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:49:46,476 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36375 2837s 2024-11-24 00:49:46,476 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36375 2837s 2024-11-24 00:49:46,476 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:49:46,476 - distributed.worker - INFO - dashboard at: 127.0.0.1:39529 2837s 2024-11-24 00:49:46,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:46,476 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:49:46,476 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:49:46,476 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:49:46,476 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z_zv5fre 2837s 2024-11-24 00:49:46,476 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:49:46,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:46,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:46,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:39916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:46,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:39918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:46,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:46,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:46,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:39926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:46,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:39932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:46,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:46,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:39938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:46,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:46,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:39950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:46,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:46,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:39960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:46,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:46,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:39972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:46,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:46,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:39980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:46,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:46,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:39994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:47,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:47,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:48,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:48,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:49,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:49,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:50,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:50,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:51,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:51,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:40990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:52,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:52,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:53,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:53,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:54,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:54,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:41426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:55,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:55,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:32994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:56,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:56,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:57,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:57,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:58,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:58,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:59,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:59,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:59,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:59,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:59,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:59,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:59,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:59,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:59,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:59,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:59,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:59,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:59,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:59,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:59,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37665 2837s 2024-11-24 00:49:59,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37665': TLS handshake failed with remote 'tls://127.0.0.1:33484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:49:59,473 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33315. Reason: failure-to-start- 2837s 2024-11-24 00:49:59,473 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:49:59,474 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 13s. 2837s 2024-11-24 00:49:59,478 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36375. Reason: failure-to-start- 2837s 2024-11-24 00:49:59,478 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:00,482 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:00,486 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34923 2837s 2024-11-24 00:50:00,486 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33549/status 2837s 2024-11-24 00:50:00,486 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:00,495 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43449 2837s 2024-11-24 00:50:00,495 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43449 2837s 2024-11-24 00:50:00,495 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:00,495 - distributed.worker - INFO - dashboard at: 127.0.0.1:38147 2837s 2024-11-24 00:50:00,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34923 2837s 2024-11-24 00:50:00,496 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:00,496 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:00,496 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:00,496 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sn5qv2gl 2837s 2024-11-24 00:50:00,496 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:00,497 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34347 2837s 2024-11-24 00:50:00,497 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34347 2837s 2024-11-24 00:50:00,497 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:00,497 - distributed.worker - INFO - dashboard at: 127.0.0.1:34921 2837s 2024-11-24 00:50:00,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34923 2837s 2024-11-24 00:50:00,498 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:00,498 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:00,498 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:00,498 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fd3q_9c3 2837s 2024-11-24 00:50:00,498 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:00,498 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43449. Reason: failure-to-start- 2837s 2024-11-24 00:50:00,498 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:00,499 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34347. Reason: failure-to-start- 2837s 2024-11-24 00:50:00,499 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:00,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34923': TLS handshake failed with remote 'tls://127.0.0.1:57270': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:00,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34923': TLS handshake failed with remote 'tls://127.0.0.1:57274': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:00,501 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:01,506 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:01,510 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39215 2837s 2024-11-24 00:50:01,510 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43239/status 2837s 2024-11-24 00:50:01,510 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:01,519 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34117 2837s 2024-11-24 00:50:01,519 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34117 2837s 2024-11-24 00:50:01,519 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:01,519 - distributed.worker - INFO - dashboard at: 127.0.0.1:42685 2837s 2024-11-24 00:50:01,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39215 2837s 2024-11-24 00:50:01,519 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:01,519 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:01,519 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:01,519 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u3zyygoi 2837s 2024-11-24 00:50:01,519 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:01,520 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40773 2837s 2024-11-24 00:50:01,521 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40773 2837s 2024-11-24 00:50:01,521 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:01,521 - distributed.worker - INFO - dashboard at: 127.0.0.1:35171 2837s 2024-11-24 00:50:01,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39215 2837s 2024-11-24 00:50:01,521 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:01,521 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:01,521 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:01,521 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l7hd3syp 2837s 2024-11-24 00:50:01,521 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:01,521 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34117. Reason: failure-to-start- 2837s 2024-11-24 00:50:01,522 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:01,522 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40773. Reason: failure-to-start- 2837s 2024-11-24 00:50:01,522 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:01,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39215': TLS handshake failed with remote 'tls://127.0.0.1:57434': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:01,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39215': TLS handshake failed with remote 'tls://127.0.0.1:57448': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:01,524 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:02,529 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:02,532 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37717 2837s 2024-11-24 00:50:02,533 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44659/status 2837s 2024-11-24 00:50:02,533 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:02,541 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44375 2837s 2024-11-24 00:50:02,541 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44375 2837s 2024-11-24 00:50:02,541 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:02,541 - distributed.worker - INFO - dashboard at: 127.0.0.1:33159 2837s 2024-11-24 00:50:02,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37717 2837s 2024-11-24 00:50:02,541 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:02,541 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:02,541 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:02,541 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h3vkke92 2837s 2024-11-24 00:50:02,541 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:02,543 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38697 2837s 2024-11-24 00:50:02,543 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38697 2837s 2024-11-24 00:50:02,543 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:02,543 - distributed.worker - INFO - dashboard at: 127.0.0.1:40259 2837s 2024-11-24 00:50:02,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37717 2837s 2024-11-24 00:50:02,543 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:02,543 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:02,543 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:02,543 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kin9_zf3 2837s 2024-11-24 00:50:02,543 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:02,544 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44375. Reason: failure-to-start- 2837s 2024-11-24 00:50:02,544 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:02,544 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38697. Reason: failure-to-start- 2837s 2024-11-24 00:50:02,544 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:02,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37717': TLS handshake failed with remote 'tls://127.0.0.1:41650': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:02,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37717': TLS handshake failed with remote 'tls://127.0.0.1:41660': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:02,546 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:03,551 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:03,554 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42835 2837s 2024-11-24 00:50:03,555 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42981/status 2837s 2024-11-24 00:50:03,555 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:03,563 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37365 2837s 2024-11-24 00:50:03,563 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37365 2837s 2024-11-24 00:50:03,563 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:03,563 - distributed.worker - INFO - dashboard at: 127.0.0.1:39985 2837s 2024-11-24 00:50:03,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42835 2837s 2024-11-24 00:50:03,563 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:03,563 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:03,563 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:03,563 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z__dcnrz 2837s 2024-11-24 00:50:03,563 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:03,564 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37859 2837s 2024-11-24 00:50:03,564 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37859 2837s 2024-11-24 00:50:03,565 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:03,565 - distributed.worker - INFO - dashboard at: 127.0.0.1:38591 2837s 2024-11-24 00:50:03,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42835 2837s 2024-11-24 00:50:03,565 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:03,565 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:03,565 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:03,565 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7_oqik8m 2837s 2024-11-24 00:50:03,565 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:03,565 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37365. Reason: failure-to-start- 2837s 2024-11-24 00:50:03,565 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:03,566 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37859. Reason: failure-to-start- 2837s 2024-11-24 00:50:03,566 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:03,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42835': TLS handshake failed with remote 'tls://127.0.0.1:47184': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:03,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42835': TLS handshake failed with remote 'tls://127.0.0.1:47198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:03,568 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:04,574 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:04,587 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34291 2837s 2024-11-24 00:50:04,588 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35503/status 2837s 2024-11-24 00:50:04,589 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:04,612 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43957 2837s 2024-11-24 00:50:04,612 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43957 2837s 2024-11-24 00:50:04,612 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:04,612 - distributed.worker - INFO - dashboard at: 127.0.0.1:33979 2837s 2024-11-24 00:50:04,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34291 2837s 2024-11-24 00:50:04,612 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:04,612 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:04,613 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:04,613 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ia6x6y1j 2837s 2024-11-24 00:50:04,613 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:04,617 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44653 2837s 2024-11-24 00:50:04,617 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44653 2837s 2024-11-24 00:50:04,617 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:04,618 - distributed.worker - INFO - dashboard at: 127.0.0.1:34981 2837s 2024-11-24 00:50:04,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34291 2837s 2024-11-24 00:50:04,618 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:04,618 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:04,618 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:04,618 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t8l3d1ca 2837s 2024-11-24 00:50:04,618 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:04,620 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43957. Reason: failure-to-start- 2837s 2024-11-24 00:50:04,620 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:04,621 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44653. Reason: failure-to-start- 2837s 2024-11-24 00:50:04,622 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:04,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34291': TLS handshake failed with remote 'tls://127.0.0.1:36492': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:04,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34291': TLS handshake failed with remote 'tls://127.0.0.1:36504': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:04,627 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:05,636 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:05,646 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44149 2837s 2024-11-24 00:50:05,647 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40371/status 2837s 2024-11-24 00:50:05,647 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:05,674 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41961 2837s 2024-11-24 00:50:05,674 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41961 2837s 2024-11-24 00:50:05,674 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:05,674 - distributed.worker - INFO - dashboard at: 127.0.0.1:44639 2837s 2024-11-24 00:50:05,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44149 2837s 2024-11-24 00:50:05,674 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:05,674 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:05,674 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:05,674 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0obo8q3o 2837s 2024-11-24 00:50:05,674 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:05,679 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46783 2837s 2024-11-24 00:50:05,679 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46783 2837s 2024-11-24 00:50:05,679 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:05,679 - distributed.worker - INFO - dashboard at: 127.0.0.1:36443 2837s 2024-11-24 00:50:05,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44149 2837s 2024-11-24 00:50:05,679 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:05,679 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:05,679 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:05,679 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q6j_q1o5 2837s 2024-11-24 00:50:05,680 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:05,682 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41961. Reason: failure-to-start- 2837s 2024-11-24 00:50:05,682 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:05,683 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46783. Reason: failure-to-start- 2837s 2024-11-24 00:50:05,683 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:05,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44149': TLS handshake failed with remote 'tls://127.0.0.1:59482': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:05,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44149': TLS handshake failed with remote 'tls://127.0.0.1:59488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:05,689 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:06,697 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:06,708 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45353 2837s 2024-11-24 00:50:06,709 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33051/status 2837s 2024-11-24 00:50:06,709 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:06,732 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43419 2837s 2024-11-24 00:50:06,732 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43419 2837s 2024-11-24 00:50:06,732 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:06,732 - distributed.worker - INFO - dashboard at: 127.0.0.1:40541 2837s 2024-11-24 00:50:06,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45353 2837s 2024-11-24 00:50:06,732 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:06,732 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:06,732 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:06,732 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2ock28ye 2837s 2024-11-24 00:50:06,733 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:06,737 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45435 2837s 2024-11-24 00:50:06,737 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45435 2837s 2024-11-24 00:50:06,737 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:06,737 - distributed.worker - INFO - dashboard at: 127.0.0.1:45781 2837s 2024-11-24 00:50:06,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45353 2837s 2024-11-24 00:50:06,737 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:06,737 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:06,737 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:06,737 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uh5s7kvd 2837s 2024-11-24 00:50:06,737 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:06,742 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43419. Reason: failure-to-start- 2837s 2024-11-24 00:50:06,743 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:06,743 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45435. Reason: failure-to-start- 2837s 2024-11-24 00:50:06,744 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:06,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45353': TLS handshake failed with remote 'tls://127.0.0.1:45250': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:06,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45353': TLS handshake failed with remote 'tls://127.0.0.1:45260': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:06,750 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:07,758 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:07,768 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45459 2837s 2024-11-24 00:50:07,769 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33291/status 2837s 2024-11-24 00:50:07,770 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:07,793 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35675 2837s 2024-11-24 00:50:07,793 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35675 2837s 2024-11-24 00:50:07,793 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:07,793 - distributed.worker - INFO - dashboard at: 127.0.0.1:41729 2837s 2024-11-24 00:50:07,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45459 2837s 2024-11-24 00:50:07,793 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:07,793 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:07,794 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:07,794 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-siwxw12e 2837s 2024-11-24 00:50:07,794 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:07,798 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40271 2837s 2024-11-24 00:50:07,798 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40271 2837s 2024-11-24 00:50:07,798 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:07,798 - distributed.worker - INFO - dashboard at: 127.0.0.1:39961 2837s 2024-11-24 00:50:07,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45459 2837s 2024-11-24 00:50:07,799 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:07,799 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:07,799 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:07,799 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ujsse770 2837s 2024-11-24 00:50:07,799 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:07,801 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35675. Reason: failure-to-start- 2837s 2024-11-24 00:50:07,802 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:07,803 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40271. Reason: failure-to-start- 2837s 2024-11-24 00:50:07,803 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:07,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45459': TLS handshake failed with remote 'tls://127.0.0.1:43964': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:07,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45459': TLS handshake failed with remote 'tls://127.0.0.1:43972': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:07,809 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:08,817 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:08,849 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38933 2837s 2024-11-24 00:50:08,850 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34151/status 2837s 2024-11-24 00:50:08,850 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:08,874 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34807 2837s 2024-11-24 00:50:08,874 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34807 2837s 2024-11-24 00:50:08,875 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:08,875 - distributed.worker - INFO - dashboard at: 127.0.0.1:33019 2837s 2024-11-24 00:50:08,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38933 2837s 2024-11-24 00:50:08,875 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:08,875 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:08,875 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:08,875 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w7dfcgh7 2837s 2024-11-24 00:50:08,875 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:08,879 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42605 2837s 2024-11-24 00:50:08,880 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42605 2837s 2024-11-24 00:50:08,880 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:08,880 - distributed.worker - INFO - dashboard at: 127.0.0.1:46781 2837s 2024-11-24 00:50:08,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38933 2837s 2024-11-24 00:50:08,880 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:08,880 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:08,880 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:08,880 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r2y6f5zr 2837s 2024-11-24 00:50:08,880 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:08,882 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34807. Reason: failure-to-start- 2837s 2024-11-24 00:50:08,883 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:08,884 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42605. Reason: failure-to-start- 2837s 2024-11-24 00:50:08,884 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:08,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38933': TLS handshake failed with remote 'tls://127.0.0.1:41338': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:08,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38933': TLS handshake failed with remote 'tls://127.0.0.1:41340': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:08,889 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:09,898 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:09,908 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46147 2837s 2024-11-24 00:50:09,909 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37671/status 2837s 2024-11-24 00:50:09,910 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:09,938 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37499 2837s 2024-11-24 00:50:09,938 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37499 2837s 2024-11-24 00:50:09,938 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:09,938 - distributed.worker - INFO - dashboard at: 127.0.0.1:45437 2837s 2024-11-24 00:50:09,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46147 2837s 2024-11-24 00:50:09,938 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:09,938 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:09,938 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:09,938 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-get1wchj 2837s 2024-11-24 00:50:09,938 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:09,943 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39217 2837s 2024-11-24 00:50:09,943 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39217 2837s 2024-11-24 00:50:09,943 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:09,943 - distributed.worker - INFO - dashboard at: 127.0.0.1:43429 2837s 2024-11-24 00:50:09,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46147 2837s 2024-11-24 00:50:09,943 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:09,943 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:09,944 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:09,944 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6hvigymw 2837s 2024-11-24 00:50:09,944 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:09,946 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37499. Reason: failure-to-start- 2837s 2024-11-24 00:50:09,946 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:09,947 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39217. Reason: failure-to-start- 2837s 2024-11-24 00:50:09,948 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:09,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46147': TLS handshake failed with remote 'tls://127.0.0.1:58546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:09,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46147': TLS handshake failed with remote 'tls://127.0.0.1:58558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:09,956 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:10,965 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:10,976 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34539 2837s 2024-11-24 00:50:10,977 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42863/status 2837s 2024-11-24 00:50:10,978 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:11,003 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40827 2837s 2024-11-24 00:50:11,003 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40827 2837s 2024-11-24 00:50:11,003 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:11,003 - distributed.worker - INFO - dashboard at: 127.0.0.1:36703 2837s 2024-11-24 00:50:11,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34539 2837s 2024-11-24 00:50:11,003 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:11,004 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:11,004 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:11,004 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z91dsf16 2837s 2024-11-24 00:50:11,004 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:11,008 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40797 2837s 2024-11-24 00:50:11,008 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40797 2837s 2024-11-24 00:50:11,008 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:11,008 - distributed.worker - INFO - dashboard at: 127.0.0.1:43259 2837s 2024-11-24 00:50:11,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34539 2837s 2024-11-24 00:50:11,008 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:11,008 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:11,008 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:11,009 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ogborxa3 2837s 2024-11-24 00:50:11,009 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:11,013 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40827. Reason: failure-to-start- 2837s 2024-11-24 00:50:11,014 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:11,015 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40797. Reason: failure-to-start- 2837s 2024-11-24 00:50:11,015 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:11,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34539': TLS handshake failed with remote 'tls://127.0.0.1:50312': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:11,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34539': TLS handshake failed with remote 'tls://127.0.0.1:50320': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:11,024 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:12,036 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:12,047 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37063 2837s 2024-11-24 00:50:12,048 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44751/status 2837s 2024-11-24 00:50:12,049 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:12,075 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35353 2837s 2024-11-24 00:50:12,075 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35353 2837s 2024-11-24 00:50:12,075 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:12,075 - distributed.worker - INFO - dashboard at: 127.0.0.1:33355 2837s 2024-11-24 00:50:12,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37063 2837s 2024-11-24 00:50:12,075 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:12,075 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:12,075 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:12,075 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9sp7o0fn 2837s 2024-11-24 00:50:12,075 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:12,080 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42495 2837s 2024-11-24 00:50:12,080 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42495 2837s 2024-11-24 00:50:12,080 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:12,080 - distributed.worker - INFO - dashboard at: 127.0.0.1:34641 2837s 2024-11-24 00:50:12,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37063 2837s 2024-11-24 00:50:12,080 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:12,080 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:12,080 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:12,080 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-045y_tqb 2837s 2024-11-24 00:50:12,080 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:12,085 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35353. Reason: failure-to-start- 2837s 2024-11-24 00:50:12,086 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:12,087 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42495. Reason: failure-to-start- 2837s 2024-11-24 00:50:12,087 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:12,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37063': TLS handshake failed with remote 'tls://127.0.0.1:51130': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:12,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37063': TLS handshake failed with remote 'tls://127.0.0.1:51144': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:12,095 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:13,101 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:13,105 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40045 2837s 2024-11-24 00:50:13,105 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38033/status 2837s 2024-11-24 00:50:13,106 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:13,115 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36451 2837s 2024-11-24 00:50:13,115 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36451 2837s 2024-11-24 00:50:13,115 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:13,115 - distributed.worker - INFO - dashboard at: 127.0.0.1:37853 2837s 2024-11-24 00:50:13,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40045 2837s 2024-11-24 00:50:13,115 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:13,115 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:13,115 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:13,115 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w5gme3gt 2837s 2024-11-24 00:50:13,115 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:13,117 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33903 2837s 2024-11-24 00:50:13,117 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33903 2837s 2024-11-24 00:50:13,117 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:13,117 - distributed.worker - INFO - dashboard at: 127.0.0.1:33113 2837s 2024-11-24 00:50:13,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40045 2837s 2024-11-24 00:50:13,117 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:13,117 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:13,117 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:13,117 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1kdz5tnw 2837s 2024-11-24 00:50:13,117 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:13,118 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36451. Reason: failure-to-start- 2837s 2024-11-24 00:50:13,118 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:13,118 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33903. Reason: failure-to-start- 2837s 2024-11-24 00:50:13,118 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:13,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40045': TLS handshake failed with remote 'tls://127.0.0.1:52474': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:13,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40045': TLS handshake failed with remote 'tls://127.0.0.1:52480': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:13,120 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:14,125 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:14,129 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45695 2837s 2024-11-24 00:50:14,129 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43441/status 2837s 2024-11-24 00:50:14,129 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:14,138 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39107 2837s 2024-11-24 00:50:14,138 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39107 2837s 2024-11-24 00:50:14,138 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:14,138 - distributed.worker - INFO - dashboard at: 127.0.0.1:40637 2837s 2024-11-24 00:50:14,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45695 2837s 2024-11-24 00:50:14,138 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:14,138 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:14,138 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:14,138 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zno03hp9 2837s 2024-11-24 00:50:14,139 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:14,141 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33093 2837s 2024-11-24 00:50:14,141 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33093 2837s 2024-11-24 00:50:14,141 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:14,141 - distributed.worker - INFO - dashboard at: 127.0.0.1:45607 2837s 2024-11-24 00:50:14,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45695 2837s 2024-11-24 00:50:14,141 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:14,141 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:14,141 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:14,141 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j9x3v73k 2837s 2024-11-24 00:50:14,141 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:14,142 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39107. Reason: failure-to-start- 2837s 2024-11-24 00:50:14,142 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:14,142 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33093. Reason: failure-to-start- 2837s 2024-11-24 00:50:14,142 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:14,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45695': TLS handshake failed with remote 'tls://127.0.0.1:49982': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:14,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45695': TLS handshake failed with remote 'tls://127.0.0.1:49984': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:14,144 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:15,149 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:15,153 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41035 2837s 2024-11-24 00:50:15,154 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33339/status 2837s 2024-11-24 00:50:15,154 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:15,164 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43879 2837s 2024-11-24 00:50:15,164 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43879 2837s 2024-11-24 00:50:15,164 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:15,164 - distributed.worker - INFO - dashboard at: 127.0.0.1:43499 2837s 2024-11-24 00:50:15,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41035 2837s 2024-11-24 00:50:15,164 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:15,164 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:15,164 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:15,164 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y5popw7a 2837s 2024-11-24 00:50:15,164 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:15,166 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45705 2837s 2024-11-24 00:50:15,166 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45705 2837s 2024-11-24 00:50:15,166 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:15,166 - distributed.worker - INFO - dashboard at: 127.0.0.1:44199 2837s 2024-11-24 00:50:15,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41035 2837s 2024-11-24 00:50:15,166 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:15,166 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:15,166 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:15,166 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b0az45hn 2837s 2024-11-24 00:50:15,166 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:15,167 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43879. Reason: failure-to-start- 2837s 2024-11-24 00:50:15,167 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:15,167 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45705. Reason: failure-to-start- 2837s 2024-11-24 00:50:15,168 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:15,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41035': TLS handshake failed with remote 'tls://127.0.0.1:35652': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:15,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41035': TLS handshake failed with remote 'tls://127.0.0.1:35658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:15,170 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:16,174 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:16,180 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39413 2837s 2024-11-24 00:50:16,180 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38669/status 2837s 2024-11-24 00:50:16,180 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:16,188 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33253 2837s 2024-11-24 00:50:16,188 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33253 2837s 2024-11-24 00:50:16,188 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:16,189 - distributed.worker - INFO - dashboard at: 127.0.0.1:42003 2837s 2024-11-24 00:50:16,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39413 2837s 2024-11-24 00:50:16,189 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:16,189 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:16,189 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:16,189 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ha81w_zc 2837s 2024-11-24 00:50:16,189 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:16,190 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33663 2837s 2024-11-24 00:50:16,190 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33663 2837s 2024-11-24 00:50:16,190 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:16,190 - distributed.worker - INFO - dashboard at: 127.0.0.1:39293 2837s 2024-11-24 00:50:16,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39413 2837s 2024-11-24 00:50:16,190 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:16,190 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:16,190 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:16,190 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2551nfdf 2837s 2024-11-24 00:50:16,191 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:16,191 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33253. Reason: failure-to-start- 2837s 2024-11-24 00:50:16,191 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:16,192 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33663. Reason: failure-to-start- 2837s 2024-11-24 00:50:16,192 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:16,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39413': TLS handshake failed with remote 'tls://127.0.0.1:50178': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:16,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39413': TLS handshake failed with remote 'tls://127.0.0.1:50182': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:16,194 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:17,197 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:17,202 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34109 2837s 2024-11-24 00:50:17,203 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34231/status 2837s 2024-11-24 00:50:17,203 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:17,212 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33599 2837s 2024-11-24 00:50:17,212 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33599 2837s 2024-11-24 00:50:17,212 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:17,212 - distributed.worker - INFO - dashboard at: 127.0.0.1:46631 2837s 2024-11-24 00:50:17,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34109 2837s 2024-11-24 00:50:17,212 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:17,212 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:17,212 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:17,212 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bjriapa9 2837s 2024-11-24 00:50:17,213 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:17,214 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44249 2837s 2024-11-24 00:50:17,214 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44249 2837s 2024-11-24 00:50:17,214 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:17,214 - distributed.worker - INFO - dashboard at: 127.0.0.1:40285 2837s 2024-11-24 00:50:17,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34109 2837s 2024-11-24 00:50:17,214 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:17,214 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:17,214 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:17,214 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bk4hsvrj 2837s 2024-11-24 00:50:17,214 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:17,216 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33599. Reason: failure-to-start- 2837s 2024-11-24 00:50:17,216 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:17,216 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44249. Reason: failure-to-start- 2837s 2024-11-24 00:50:17,216 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:17,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34109': TLS handshake failed with remote 'tls://127.0.0.1:40186': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:17,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34109': TLS handshake failed with remote 'tls://127.0.0.1:40198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:17,218 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:18,223 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:18,227 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46259 2837s 2024-11-24 00:50:18,227 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45051/status 2837s 2024-11-24 00:50:18,228 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:18,237 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39025 2837s 2024-11-24 00:50:18,237 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39025 2837s 2024-11-24 00:50:18,237 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:18,237 - distributed.worker - INFO - dashboard at: 127.0.0.1:36419 2837s 2024-11-24 00:50:18,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46259 2837s 2024-11-24 00:50:18,237 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:18,237 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:18,237 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:18,237 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7jfs21wt 2837s 2024-11-24 00:50:18,237 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:18,239 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43597 2837s 2024-11-24 00:50:18,239 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43597 2837s 2024-11-24 00:50:18,239 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:18,239 - distributed.worker - INFO - dashboard at: 127.0.0.1:36133 2837s 2024-11-24 00:50:18,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46259 2837s 2024-11-24 00:50:18,239 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:18,239 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:18,239 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:18,239 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rl56wn5c 2837s 2024-11-24 00:50:18,239 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:18,241 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39025. Reason: failure-to-start- 2837s 2024-11-24 00:50:18,241 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:18,241 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43597. Reason: failure-to-start- 2837s 2024-11-24 00:50:18,241 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:18,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46259': TLS handshake failed with remote 'tls://127.0.0.1:54328': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:18,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46259': TLS handshake failed with remote 'tls://127.0.0.1:54336': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:18,244 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:19,249 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:19,253 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39591 2837s 2024-11-24 00:50:19,253 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46521/status 2837s 2024-11-24 00:50:19,253 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:19,262 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41869 2837s 2024-11-24 00:50:19,262 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41869 2837s 2024-11-24 00:50:19,262 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:19,262 - distributed.worker - INFO - dashboard at: 127.0.0.1:39555 2837s 2024-11-24 00:50:19,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39591 2837s 2024-11-24 00:50:19,262 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:19,262 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:19,262 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:19,262 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eusw6fy6 2837s 2024-11-24 00:50:19,263 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:19,264 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43829 2837s 2024-11-24 00:50:19,264 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43829 2837s 2024-11-24 00:50:19,264 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:19,264 - distributed.worker - INFO - dashboard at: 127.0.0.1:34063 2837s 2024-11-24 00:50:19,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39591 2837s 2024-11-24 00:50:19,264 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:19,264 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:19,264 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:19,264 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c8fpl4gn 2837s 2024-11-24 00:50:19,264 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:19,265 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41869. Reason: failure-to-start- 2837s 2024-11-24 00:50:19,265 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:19,266 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43829. Reason: failure-to-start- 2837s 2024-11-24 00:50:19,266 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:19,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39591': TLS handshake failed with remote 'tls://127.0.0.1:39276': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:19,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39591': TLS handshake failed with remote 'tls://127.0.0.1:39278': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:19,268 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:20,272 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:20,278 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44761 2837s 2024-11-24 00:50:20,278 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46683/status 2837s 2024-11-24 00:50:20,278 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:20,288 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34761 2837s 2024-11-24 00:50:20,288 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34761 2837s 2024-11-24 00:50:20,288 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:20,289 - distributed.worker - INFO - dashboard at: 127.0.0.1:40463 2837s 2024-11-24 00:50:20,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44761 2837s 2024-11-24 00:50:20,289 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:20,289 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:20,289 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:20,289 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rwhckddv 2837s 2024-11-24 00:50:20,289 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:20,290 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38075 2837s 2024-11-24 00:50:20,290 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38075 2837s 2024-11-24 00:50:20,290 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:20,290 - distributed.worker - INFO - dashboard at: 127.0.0.1:42557 2837s 2024-11-24 00:50:20,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44761 2837s 2024-11-24 00:50:20,291 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:20,291 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:20,291 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:20,291 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mtml51_3 2837s 2024-11-24 00:50:20,291 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:20,292 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34761. Reason: failure-to-start- 2837s 2024-11-24 00:50:20,292 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:20,292 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38075. Reason: failure-to-start- 2837s 2024-11-24 00:50:20,292 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:20,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44761': TLS handshake failed with remote 'tls://127.0.0.1:56574': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:20,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44761': TLS handshake failed with remote 'tls://127.0.0.1:56582': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:20,294 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:21,299 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:21,303 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37085 2837s 2024-11-24 00:50:21,304 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37569/status 2837s 2024-11-24 00:50:21,304 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:21,315 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41533 2837s 2024-11-24 00:50:21,315 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41533 2837s 2024-11-24 00:50:21,315 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:21,315 - distributed.worker - INFO - dashboard at: 127.0.0.1:33005 2837s 2024-11-24 00:50:21,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37085 2837s 2024-11-24 00:50:21,315 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:21,315 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:21,315 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:21,315 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n5t9qoww 2837s 2024-11-24 00:50:21,315 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:21,317 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46751 2837s 2024-11-24 00:50:21,317 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46751 2837s 2024-11-24 00:50:21,317 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:21,317 - distributed.worker - INFO - dashboard at: 127.0.0.1:39929 2837s 2024-11-24 00:50:21,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37085 2837s 2024-11-24 00:50:21,317 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:21,317 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:21,317 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:21,317 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-idp6v7ui 2837s 2024-11-24 00:50:21,317 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:21,318 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41533. Reason: failure-to-start- 2837s 2024-11-24 00:50:21,318 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:21,319 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46751. Reason: failure-to-start- 2837s 2024-11-24 00:50:21,319 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:21,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37085': TLS handshake failed with remote 'tls://127.0.0.1:50466': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:21,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37085': TLS handshake failed with remote 'tls://127.0.0.1:50470': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:21,321 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:22,325 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:22,329 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39363 2837s 2024-11-24 00:50:22,330 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42987/status 2837s 2024-11-24 00:50:22,330 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:22,339 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41071 2837s 2024-11-24 00:50:22,340 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41071 2837s 2024-11-24 00:50:22,340 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:22,340 - distributed.worker - INFO - dashboard at: 127.0.0.1:44439 2837s 2024-11-24 00:50:22,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39363 2837s 2024-11-24 00:50:22,340 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:22,340 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:22,340 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:22,340 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o81_z2qo 2837s 2024-11-24 00:50:22,340 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:22,341 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33899 2837s 2024-11-24 00:50:22,342 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33899 2837s 2024-11-24 00:50:22,342 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:22,342 - distributed.worker - INFO - dashboard at: 127.0.0.1:39789 2837s 2024-11-24 00:50:22,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39363 2837s 2024-11-24 00:50:22,343 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:22,343 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:22,343 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:22,343 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-whm4vw1i 2837s 2024-11-24 00:50:22,343 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:22,344 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41071. Reason: failure-to-start- 2837s 2024-11-24 00:50:22,344 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:22,344 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33899. Reason: failure-to-start- 2837s 2024-11-24 00:50:22,344 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:22,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39363': TLS handshake failed with remote 'tls://127.0.0.1:49418': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:22,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39363': TLS handshake failed with remote 'tls://127.0.0.1:49426': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:22,346 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:23,351 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:23,356 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38227 2837s 2024-11-24 00:50:23,356 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44327/status 2837s 2024-11-24 00:50:23,356 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:23,366 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44601 2837s 2024-11-24 00:50:23,366 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44601 2837s 2024-11-24 00:50:23,366 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:23,366 - distributed.worker - INFO - dashboard at: 127.0.0.1:43861 2837s 2024-11-24 00:50:23,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38227 2837s 2024-11-24 00:50:23,366 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:23,366 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:23,367 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:23,367 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7d1arbme 2837s 2024-11-24 00:50:23,367 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:23,368 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42563 2837s 2024-11-24 00:50:23,368 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42563 2837s 2024-11-24 00:50:23,368 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:23,368 - distributed.worker - INFO - dashboard at: 127.0.0.1:34183 2837s 2024-11-24 00:50:23,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38227 2837s 2024-11-24 00:50:23,368 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:23,368 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:23,368 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:23,368 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ou64fcy_ 2837s 2024-11-24 00:50:23,369 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:23,369 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44601. Reason: failure-to-start- 2837s 2024-11-24 00:50:23,369 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:23,370 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42563. Reason: failure-to-start- 2837s 2024-11-24 00:50:23,370 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:23,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38227': TLS handshake failed with remote 'tls://127.0.0.1:58730': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:23,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38227': TLS handshake failed with remote 'tls://127.0.0.1:58734': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:23,372 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:24,377 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:24,382 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43649 2837s 2024-11-24 00:50:24,382 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38125/status 2837s 2024-11-24 00:50:24,382 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:24,392 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36283 2837s 2024-11-24 00:50:24,392 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36283 2837s 2024-11-24 00:50:24,392 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:24,392 - distributed.worker - INFO - dashboard at: 127.0.0.1:44773 2837s 2024-11-24 00:50:24,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43649 2837s 2024-11-24 00:50:24,392 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:24,392 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:24,392 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:24,392 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i1kk2uio 2837s 2024-11-24 00:50:24,392 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:24,394 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40533 2837s 2024-11-24 00:50:24,394 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40533 2837s 2024-11-24 00:50:24,394 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:24,394 - distributed.worker - INFO - dashboard at: 127.0.0.1:42729 2837s 2024-11-24 00:50:24,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43649 2837s 2024-11-24 00:50:24,394 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:24,394 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:24,394 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:24,394 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7lzw7x_t 2837s 2024-11-24 00:50:24,394 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:24,395 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36283. Reason: failure-to-start- 2837s 2024-11-24 00:50:24,395 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:24,395 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40533. Reason: failure-to-start- 2837s 2024-11-24 00:50:24,396 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:24,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43649': TLS handshake failed with remote 'tls://127.0.0.1:48356': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:24,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43649': TLS handshake failed with remote 'tls://127.0.0.1:48358': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:24,398 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:25,402 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:25,407 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45587 2837s 2024-11-24 00:50:25,407 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40303/status 2837s 2024-11-24 00:50:25,407 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:25,430 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32923 2837s 2024-11-24 00:50:25,430 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32923 2837s 2024-11-24 00:50:25,430 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:25,430 - distributed.worker - INFO - dashboard at: 127.0.0.1:37741 2837s 2024-11-24 00:50:25,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:50:25,430 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:25,430 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:25,430 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:25,430 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b3pyae74 2837s 2024-11-24 00:50:25,430 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:25,432 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44053 2837s 2024-11-24 00:50:25,432 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44053 2837s 2024-11-24 00:50:25,432 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:25,432 - distributed.worker - INFO - dashboard at: 127.0.0.1:34643 2837s 2024-11-24 00:50:25,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:50:25,432 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:25,432 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:25,432 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:25,432 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1g1ieg0q 2837s 2024-11-24 00:50:25,432 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:25,434 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32923. Reason: failure-to-start- 2837s 2024-11-24 00:50:25,434 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:25,435 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44053. Reason: failure-to-start- 2837s 2024-11-24 00:50:25,435 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:25,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:46306': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:25,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:46318': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:25,437 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:26,441 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:26,445 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44027 2837s 2024-11-24 00:50:26,446 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45221/status 2837s 2024-11-24 00:50:26,446 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:26,456 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46571 2837s 2024-11-24 00:50:26,457 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46571 2837s 2024-11-24 00:50:26,457 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:26,457 - distributed.worker - INFO - dashboard at: 127.0.0.1:38853 2837s 2024-11-24 00:50:26,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44027 2837s 2024-11-24 00:50:26,457 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:26,457 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:26,457 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:26,457 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w9c2bkdw 2837s 2024-11-24 00:50:26,457 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:26,460 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35415 2837s 2024-11-24 00:50:26,460 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35415 2837s 2024-11-24 00:50:26,460 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:26,460 - distributed.worker - INFO - dashboard at: 127.0.0.1:34405 2837s 2024-11-24 00:50:26,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44027 2837s 2024-11-24 00:50:26,460 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:26,460 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:26,460 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:26,460 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kvrmzs6p 2837s 2024-11-24 00:50:26,460 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:26,461 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46571. Reason: failure-to-start- 2837s 2024-11-24 00:50:26,461 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:26,461 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35415. Reason: failure-to-start- 2837s 2024-11-24 00:50:26,462 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:26,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44027': TLS handshake failed with remote 'tls://127.0.0.1:37476': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:26,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44027': TLS handshake failed with remote 'tls://127.0.0.1:37488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:26,464 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:27,469 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:27,473 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34829 2837s 2024-11-24 00:50:27,473 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41991/status 2837s 2024-11-24 00:50:27,473 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:27,482 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38943 2837s 2024-11-24 00:50:27,482 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38943 2837s 2024-11-24 00:50:27,482 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:27,482 - distributed.worker - INFO - dashboard at: 127.0.0.1:33619 2837s 2024-11-24 00:50:27,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34829 2837s 2024-11-24 00:50:27,482 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:27,482 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:27,482 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:27,483 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g_yfcytd 2837s 2024-11-24 00:50:27,483 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:27,484 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34605 2837s 2024-11-24 00:50:27,484 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34605 2837s 2024-11-24 00:50:27,484 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:27,484 - distributed.worker - INFO - dashboard at: 127.0.0.1:36233 2837s 2024-11-24 00:50:27,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34829 2837s 2024-11-24 00:50:27,484 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:27,484 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:27,484 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:27,484 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dwyw5a8d 2837s 2024-11-24 00:50:27,484 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:27,486 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38943. Reason: failure-to-start- 2837s 2024-11-24 00:50:27,486 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:27,487 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34605. Reason: failure-to-start- 2837s 2024-11-24 00:50:27,487 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:27,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34829': TLS handshake failed with remote 'tls://127.0.0.1:59240': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:27,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34829': TLS handshake failed with remote 'tls://127.0.0.1:59248': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:27,489 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:28,494 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:28,500 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45419 2837s 2024-11-24 00:50:28,500 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39027/status 2837s 2024-11-24 00:50:28,500 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:28,509 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39475 2837s 2024-11-24 00:50:28,509 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39475 2837s 2024-11-24 00:50:28,509 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:28,509 - distributed.worker - INFO - dashboard at: 127.0.0.1:40781 2837s 2024-11-24 00:50:28,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45419 2837s 2024-11-24 00:50:28,509 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:28,509 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:28,509 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:28,510 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z5bjm7vl 2837s 2024-11-24 00:50:28,510 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:28,511 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44259 2837s 2024-11-24 00:50:28,511 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44259 2837s 2024-11-24 00:50:28,511 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:28,511 - distributed.worker - INFO - dashboard at: 127.0.0.1:32873 2837s 2024-11-24 00:50:28,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45419 2837s 2024-11-24 00:50:28,511 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:28,511 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:28,511 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:28,511 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g5jd__kp 2837s 2024-11-24 00:50:28,512 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:28,513 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39475. Reason: failure-to-start- 2837s 2024-11-24 00:50:28,513 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:28,513 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44259. Reason: failure-to-start- 2837s 2024-11-24 00:50:28,513 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:28,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45419': TLS handshake failed with remote 'tls://127.0.0.1:47164': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:28,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45419': TLS handshake failed with remote 'tls://127.0.0.1:47170': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:28,517 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:50:29,521 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:29,525 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45181 2837s 2024-11-24 00:50:29,526 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45479/status 2837s 2024-11-24 00:50:29,526 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:29,536 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34031 2837s 2024-11-24 00:50:29,537 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34031 2837s 2024-11-24 00:50:29,537 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:29,537 - distributed.worker - INFO - dashboard at: 127.0.0.1:34837 2837s 2024-11-24 00:50:29,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45181 2837s 2024-11-24 00:50:29,537 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:29,537 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:50:29,537 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:29,537 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xiedazek 2837s 2024-11-24 00:50:29,537 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:29,538 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45681 2837s 2024-11-24 00:50:29,538 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45681 2837s 2024-11-24 00:50:29,538 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:29,538 - distributed.worker - INFO - dashboard at: 127.0.0.1:39733 2837s 2024-11-24 00:50:29,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45181 2837s 2024-11-24 00:50:29,539 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:29,539 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:29,539 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:29,539 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cng6okpq 2837s 2024-11-24 00:50:29,539 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:29,540 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34031. Reason: failure-to-start- 2837s 2024-11-24 00:50:29,541 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:29,541 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45681. Reason: failure-to-start- 2837s 2024-11-24 00:50:29,541 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:29,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45181': TLS handshake failed with remote 'tls://127.0.0.1:45804': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:29,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45181': TLS handshake failed with remote 'tls://127.0.0.1:45806': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:50:29,543 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s ______________________________ test_work_stealing ______________________________ 2837s 2837s fut = , timeout = 0 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 2837s await self._register_with_scheduler() 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2837s comm = await wait_for( 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2837s return await fut 2837s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 2837s stream = await self.client.connect( 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s host = '127.0.0.1', port = 39203, af = 2837s ssl_options = 2837s max_buffer_size = 4151066624.0, source_ip = None, source_port = None 2837s timeout = None 2837s 2837s async def connect( 2837s self, 2837s host: str, 2837s port: int, 2837s af: socket.AddressFamily = socket.AF_UNSPEC, 2837s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 2837s max_buffer_size: Optional[int] = None, 2837s source_ip: Optional[str] = None, 2837s source_port: Optional[int] = None, 2837s timeout: Optional[Union[float, datetime.timedelta]] = None, 2837s ) -> IOStream: 2837s """Connect to the given host and port. 2837s 2837s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 2837s ``ssl_options`` is not None). 2837s 2837s Using the ``source_ip`` kwarg, one can specify the source 2837s IP address to use when establishing the connection. 2837s In case the user needs to resolve and 2837s use a specific interface, it has to be handled outside 2837s of Tornado as this depends very much on the platform. 2837s 2837s Raises `TimeoutError` if the input future does not complete before 2837s ``timeout``, which may be specified in any form allowed by 2837s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 2837s relative to `.IOLoop.time`) 2837s 2837s Similarly, when the user requires a certain source port, it can 2837s be specified using the ``source_port`` arg. 2837s 2837s .. versionchanged:: 4.5 2837s Added the ``source_ip`` and ``source_port`` arguments. 2837s 2837s .. versionchanged:: 5.0 2837s Added the ``timeout`` argument. 2837s """ 2837s if timeout is not None: 2837s if isinstance(timeout, numbers.Real): 2837s timeout = IOLoop.current().time() + timeout 2837s elif isinstance(timeout, datetime.timedelta): 2837s timeout = IOLoop.current().time() + timeout.total_seconds() 2837s else: 2837s raise TypeError("Unsupported timeout %r" % timeout) 2837s if timeout is not None: 2837s addrinfo = await gen.with_timeout( 2837s timeout, self.resolver.resolve(host, port, af) 2837s ) 2837s else: 2837s addrinfo = await self.resolver.resolve(host, port, af) 2837s connector = _Connector( 2837s addrinfo, 2837s functools.partial( 2837s self._create_stream, 2837s max_buffer_size, 2837s source_ip=source_ip, 2837s source_port=source_port, 2837s ), 2837s ) 2837s > af, addr, stream = await connector.start(connect_timeout=timeout) 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s > await wait_for(self.start_unsafe(), timeout=timeout) 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:664: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s @contextlib.asynccontextmanager 2837s async def _cluster_factory(): 2837s workers = [] 2837s s = None 2837s try: 2837s for _ in range(60): 2837s try: 2837s > s, ws = await start_cluster( 2837s nthreads, 2837s scheduler, 2837s security=security, 2837s Worker=Worker, 2837s scheduler_kwargs=scheduler_kwargs, 2837s worker_kwargs=merge( 2837s {"death_timeout": min(15, int(deadline.remaining))}, 2837s worker_kwargs, 2837s ), 2837s ) 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 2837s await asyncio.gather(*workers) 2837s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 2837s return await awaitable 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s except asyncio.TimeoutError as exc: 2837s await _close_on_failure(exc) 2837s > raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s E TimeoutError: Worker start timed out after 0s. 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s fut = ._..test_func..async_fn at 0xe63f7717b300> 2837s timeout = 60 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 2837s _cluster_factory() as (s, workers), 2837s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 2837s return await anext(self.gen) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 2837s await asyncio.sleep(1) 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s delay = 1, result = None 2837s 2837s async def sleep(delay, result=None): 2837s """Coroutine that completes after a given time (in seconds).""" 2837s if delay <= 0: 2837s await __sleep0() 2837s return result 2837s 2837s if math.isnan(delay): 2837s raise ValueError("Invalid delay: NaN (not a number)") 2837s 2837s loop = events.get_running_loop() 2837s future = loop.create_future() 2837s h = loop.call_later(delay, 2837s futures._set_result_unless_cancelled, 2837s future, result) 2837s try: 2837s > return await future 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s args = (), kwds = {} 2837s 2837s @wraps(func) 2837s def inner(*args, **kwds): 2837s with self._recreate_cm(): 2837s > return func(*args, **kwds) 2837s 2837s /usr/lib/python3.13/contextlib.py:85: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3.13/contextlib.py:85: in inner 2837s return func(*args, **kwds) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 2837s return _run_and_close_tornado(async_fn_outer) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 2837s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 2837s /usr/lib/python3.13/asyncio/runners.py:194: in run 2837s return runner.run(main) 2837s /usr/lib/python3.13/asyncio/runners.py:118: in run 2837s return self._loop.run_until_complete(task) 2837s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 2837s return future.result() 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 2837s return await async_fn(*args, **kwargs) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 2837s return await utils_wait_for(async_fn(), timeout=timeout * 2) 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s ----------------------------- Captured stderr call ----------------------------- 2837s 2024-11-24 00:50:30,941 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:30,945 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:30,945 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33527/status 2837s 2024-11-24 00:50:30,946 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:30,954 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44249 2837s 2024-11-24 00:50:30,955 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44249 2837s 2024-11-24 00:50:30,955 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:30,955 - distributed.worker - INFO - dashboard at: 127.0.0.1:33467 2837s 2024-11-24 00:50:30,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:30,955 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:30,955 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:30,955 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:30,955 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4cj4sj5i 2837s 2024-11-24 00:50:30,955 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:30,956 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41345 2837s 2024-11-24 00:50:30,956 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41345 2837s 2024-11-24 00:50:30,956 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:30,956 - distributed.worker - INFO - dashboard at: 127.0.0.1:40297 2837s 2024-11-24 00:50:30,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:30,957 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:30,957 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:30,957 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:30,957 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3tejhe3b 2837s 2024-11-24 00:50:30,957 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:30,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:30,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:30,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:30,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:31,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:31,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:32,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:32,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:33,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:33,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:34,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:34,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:43338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:37994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:35,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:35,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:36,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:36,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:37,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:37,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:38,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:38,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:39,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:39,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:40,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:40,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:38998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:41,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:41,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:42,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:42,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:43,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:43,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:44,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:44,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:39638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:33518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:33534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:33540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:33548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:33558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:33562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:33568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:33576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:33582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:33588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:33598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39623 2837s 2024-11-24 00:50:45,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:33612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:45,954 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44249. Reason: failure-to-start- 2837s 2024-11-24 00:50:45,954 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:45,955 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 15s. 2837s 2024-11-24 00:50:45,958 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41345. Reason: failure-to-start- 2837s 2024-11-24 00:50:45,958 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:46,961 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:50:46,966 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:46,967 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35913/status 2837s 2024-11-24 00:50:46,967 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:50:46,976 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35175 2837s 2024-11-24 00:50:46,977 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35175 2837s 2024-11-24 00:50:46,977 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:50:46,977 - distributed.worker - INFO - dashboard at: 127.0.0.1:40245 2837s 2024-11-24 00:50:46,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:46,977 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:46,977 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:46,977 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:46,977 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oo6snd2g 2837s 2024-11-24 00:50:46,977 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:46,978 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43717 2837s 2024-11-24 00:50:46,979 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43717 2837s 2024-11-24 00:50:46,979 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:50:46,979 - distributed.worker - INFO - dashboard at: 127.0.0.1:42885 2837s 2024-11-24 00:50:46,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:46,979 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:46,979 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:50:46,979 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:50:46,979 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hvmwz4yu 2837s 2024-11-24 00:50:46,979 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:50:46,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:46,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:46,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:46,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:47,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:47,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:48,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:48,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:49,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:49,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:50,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:50,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:50,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:50,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:50,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:50,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:50,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:50,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:50,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:50,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:50,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:50,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:50,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:50,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:50,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:50,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:50,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:50,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:50,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:50,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:50,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:50,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:50,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:50,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:50,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:50,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:50,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:50,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:50,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:50,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:50,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:50,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:39990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:51,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:51,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:52,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:52,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:53,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:53,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:54,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:54,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:54,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:54,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:54,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:54,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:54,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:54,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:54,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:54,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:54,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:54,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:54,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:54,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:54,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:54,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:54,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:54,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:54,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:54,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:54,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:54,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:54,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:54,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:54,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:54,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:54,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:54,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:54,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:54,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:54,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:54,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:40584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:55,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:55,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:56,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:56,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:57,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:57,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:56988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:58,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:58,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44919 2837s 2024-11-24 00:50:59,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44919': TLS handshake failed with remote 'tls://127.0.0.1:57288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:50:59,976 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35175. Reason: failure-to-start- 2837s 2024-11-24 00:50:59,976 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:50:59,977 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 13s. 2837s 2024-11-24 00:50:59,980 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43717. Reason: failure-to-start- 2837s 2024-11-24 00:50:59,980 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:00,983 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:00,987 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37487 2837s 2024-11-24 00:51:00,987 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46049/status 2837s 2024-11-24 00:51:00,987 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:00,995 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40821 2837s 2024-11-24 00:51:00,996 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40821 2837s 2024-11-24 00:51:00,996 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:00,996 - distributed.worker - INFO - dashboard at: 127.0.0.1:38691 2837s 2024-11-24 00:51:00,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37487 2837s 2024-11-24 00:51:00,996 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:00,996 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:00,996 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:00,996 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tzyio2b_ 2837s 2024-11-24 00:51:00,996 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:00,997 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41901 2837s 2024-11-24 00:51:00,997 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41901 2837s 2024-11-24 00:51:00,997 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:00,997 - distributed.worker - INFO - dashboard at: 127.0.0.1:43567 2837s 2024-11-24 00:51:00,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37487 2837s 2024-11-24 00:51:00,997 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:00,997 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:00,997 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:00,997 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-92_sybzi 2837s 2024-11-24 00:51:00,998 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:00,998 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40821. Reason: failure-to-start- 2837s 2024-11-24 00:51:00,998 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:00,999 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41901. Reason: failure-to-start- 2837s 2024-11-24 00:51:00,999 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:00,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37487': TLS handshake failed with remote 'tls://127.0.0.1:60054': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:00,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37487': TLS handshake failed with remote 'tls://127.0.0.1:60060': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:01,000 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:02,005 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:02,009 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35581 2837s 2024-11-24 00:51:02,009 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42469/status 2837s 2024-11-24 00:51:02,010 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:02,018 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45013 2837s 2024-11-24 00:51:02,019 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45013 2837s 2024-11-24 00:51:02,019 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:02,019 - distributed.worker - INFO - dashboard at: 127.0.0.1:43735 2837s 2024-11-24 00:51:02,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35581 2837s 2024-11-24 00:51:02,019 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:02,019 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:02,019 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:02,019 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w3mwr4xp 2837s 2024-11-24 00:51:02,019 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:02,020 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33113 2837s 2024-11-24 00:51:02,020 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33113 2837s 2024-11-24 00:51:02,020 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:02,020 - distributed.worker - INFO - dashboard at: 127.0.0.1:42209 2837s 2024-11-24 00:51:02,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35581 2837s 2024-11-24 00:51:02,020 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:02,020 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:02,021 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:02,021 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y7gggp9_ 2837s 2024-11-24 00:51:02,021 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:02,021 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45013. Reason: failure-to-start- 2837s 2024-11-24 00:51:02,021 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:02,022 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33113. Reason: failure-to-start- 2837s 2024-11-24 00:51:02,022 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:02,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35581': TLS handshake failed with remote 'tls://127.0.0.1:55276': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:02,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35581': TLS handshake failed with remote 'tls://127.0.0.1:55290': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:02,024 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:03,028 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:03,032 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42237 2837s 2024-11-24 00:51:03,033 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34737/status 2837s 2024-11-24 00:51:03,033 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:03,042 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36935 2837s 2024-11-24 00:51:03,043 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36935 2837s 2024-11-24 00:51:03,043 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:03,043 - distributed.worker - INFO - dashboard at: 127.0.0.1:40763 2837s 2024-11-24 00:51:03,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42237 2837s 2024-11-24 00:51:03,043 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:03,043 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:03,043 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:03,043 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0esql5e6 2837s 2024-11-24 00:51:03,043 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:03,044 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36173 2837s 2024-11-24 00:51:03,044 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36173 2837s 2024-11-24 00:51:03,044 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:03,044 - distributed.worker - INFO - dashboard at: 127.0.0.1:42385 2837s 2024-11-24 00:51:03,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42237 2837s 2024-11-24 00:51:03,045 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:03,045 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:03,045 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:03,045 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ji4658tw 2837s 2024-11-24 00:51:03,045 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:03,045 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36935. Reason: failure-to-start- 2837s 2024-11-24 00:51:03,045 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:03,046 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36173. Reason: failure-to-start- 2837s 2024-11-24 00:51:03,046 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:03,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42237': TLS handshake failed with remote 'tls://127.0.0.1:42056': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:03,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42237': TLS handshake failed with remote 'tls://127.0.0.1:42064': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:03,048 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:04,052 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:04,056 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40181 2837s 2024-11-24 00:51:04,056 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43975/status 2837s 2024-11-24 00:51:04,056 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:04,065 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34951 2837s 2024-11-24 00:51:04,065 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34951 2837s 2024-11-24 00:51:04,065 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:04,065 - distributed.worker - INFO - dashboard at: 127.0.0.1:44427 2837s 2024-11-24 00:51:04,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40181 2837s 2024-11-24 00:51:04,065 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:04,065 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:04,065 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:04,065 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f7g_fo7n 2837s 2024-11-24 00:51:04,065 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:04,066 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43329 2837s 2024-11-24 00:51:04,066 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43329 2837s 2024-11-24 00:51:04,067 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:04,067 - distributed.worker - INFO - dashboard at: 127.0.0.1:37699 2837s 2024-11-24 00:51:04,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40181 2837s 2024-11-24 00:51:04,067 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:04,067 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:04,067 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:04,067 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-__16r62c 2837s 2024-11-24 00:51:04,067 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:04,067 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34951. Reason: failure-to-start- 2837s 2024-11-24 00:51:04,068 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:04,068 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43329. Reason: failure-to-start- 2837s 2024-11-24 00:51:04,068 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:04,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40181': TLS handshake failed with remote 'tls://127.0.0.1:47860': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:04,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40181': TLS handshake failed with remote 'tls://127.0.0.1:47862': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:04,070 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:05,075 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:05,079 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43795 2837s 2024-11-24 00:51:05,080 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42225/status 2837s 2024-11-24 00:51:05,080 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:05,089 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36923 2837s 2024-11-24 00:51:05,089 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36923 2837s 2024-11-24 00:51:05,089 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:05,089 - distributed.worker - INFO - dashboard at: 127.0.0.1:39909 2837s 2024-11-24 00:51:05,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43795 2837s 2024-11-24 00:51:05,089 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:05,089 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:05,089 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:05,089 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wplnfwht 2837s 2024-11-24 00:51:05,089 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:05,090 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44123 2837s 2024-11-24 00:51:05,091 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44123 2837s 2024-11-24 00:51:05,091 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:05,091 - distributed.worker - INFO - dashboard at: 127.0.0.1:40419 2837s 2024-11-24 00:51:05,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43795 2837s 2024-11-24 00:51:05,091 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:05,091 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:05,091 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:05,091 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-brfcw32m 2837s 2024-11-24 00:51:05,091 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:05,091 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36923. Reason: failure-to-start- 2837s 2024-11-24 00:51:05,092 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:05,092 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44123. Reason: failure-to-start- 2837s 2024-11-24 00:51:05,092 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:05,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43795': TLS handshake failed with remote 'tls://127.0.0.1:48252': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:05,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43795': TLS handshake failed with remote 'tls://127.0.0.1:48256': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:05,094 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:06,098 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:06,103 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46753 2837s 2024-11-24 00:51:06,103 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45595/status 2837s 2024-11-24 00:51:06,103 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:06,113 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36449 2837s 2024-11-24 00:51:06,113 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36449 2837s 2024-11-24 00:51:06,113 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:06,113 - distributed.worker - INFO - dashboard at: 127.0.0.1:32809 2837s 2024-11-24 00:51:06,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46753 2837s 2024-11-24 00:51:06,114 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:06,114 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:06,114 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:06,114 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bhg82sd0 2837s 2024-11-24 00:51:06,114 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:06,115 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39911 2837s 2024-11-24 00:51:06,115 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39911 2837s 2024-11-24 00:51:06,115 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:06,115 - distributed.worker - INFO - dashboard at: 127.0.0.1:38957 2837s 2024-11-24 00:51:06,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46753 2837s 2024-11-24 00:51:06,115 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:06,115 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:06,116 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:06,116 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jt66tpcx 2837s 2024-11-24 00:51:06,116 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:06,116 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36449. Reason: failure-to-start- 2837s 2024-11-24 00:51:06,116 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:06,117 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39911. Reason: failure-to-start- 2837s 2024-11-24 00:51:06,117 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:06,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46753': TLS handshake failed with remote 'tls://127.0.0.1:59272': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:06,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46753': TLS handshake failed with remote 'tls://127.0.0.1:59278': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:06,119 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:07,123 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:07,127 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33135 2837s 2024-11-24 00:51:07,128 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41013/status 2837s 2024-11-24 00:51:07,128 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:07,137 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37269 2837s 2024-11-24 00:51:07,137 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37269 2837s 2024-11-24 00:51:07,137 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:07,137 - distributed.worker - INFO - dashboard at: 127.0.0.1:43243 2837s 2024-11-24 00:51:07,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33135 2837s 2024-11-24 00:51:07,137 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:07,137 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:07,137 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:07,137 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pz7c74ld 2837s 2024-11-24 00:51:07,137 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:07,142 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35109 2837s 2024-11-24 00:51:07,143 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35109 2837s 2024-11-24 00:51:07,143 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:07,143 - distributed.worker - INFO - dashboard at: 127.0.0.1:41251 2837s 2024-11-24 00:51:07,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33135 2837s 2024-11-24 00:51:07,143 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:07,143 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:07,143 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:07,143 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-89rwc8rd 2837s 2024-11-24 00:51:07,143 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:07,144 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37269. Reason: failure-to-start- 2837s 2024-11-24 00:51:07,144 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:07,144 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35109. Reason: failure-to-start- 2837s 2024-11-24 00:51:07,144 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:07,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33135': TLS handshake failed with remote 'tls://127.0.0.1:53162': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:07,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33135': TLS handshake failed with remote 'tls://127.0.0.1:53170': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:07,147 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:08,151 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:08,156 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39105 2837s 2024-11-24 00:51:08,156 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33773/status 2837s 2024-11-24 00:51:08,156 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:08,166 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41955 2837s 2024-11-24 00:51:08,167 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41955 2837s 2024-11-24 00:51:08,167 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:08,167 - distributed.worker - INFO - dashboard at: 127.0.0.1:39661 2837s 2024-11-24 00:51:08,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39105 2837s 2024-11-24 00:51:08,167 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:08,167 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:08,167 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:08,167 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f17dyhdt 2837s 2024-11-24 00:51:08,167 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:08,169 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33333 2837s 2024-11-24 00:51:08,169 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33333 2837s 2024-11-24 00:51:08,169 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:08,169 - distributed.worker - INFO - dashboard at: 127.0.0.1:44353 2837s 2024-11-24 00:51:08,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39105 2837s 2024-11-24 00:51:08,169 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:08,169 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:08,169 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:08,169 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-35yesg0p 2837s 2024-11-24 00:51:08,169 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:08,170 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41955. Reason: failure-to-start- 2837s 2024-11-24 00:51:08,170 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:08,170 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33333. Reason: failure-to-start- 2837s 2024-11-24 00:51:08,170 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:08,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39105': TLS handshake failed with remote 'tls://127.0.0.1:49338': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:08,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39105': TLS handshake failed with remote 'tls://127.0.0.1:49346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:08,173 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:09,178 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:09,183 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37315 2837s 2024-11-24 00:51:09,184 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40981/status 2837s 2024-11-24 00:51:09,184 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:09,193 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44611 2837s 2024-11-24 00:51:09,193 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44611 2837s 2024-11-24 00:51:09,194 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:09,194 - distributed.worker - INFO - dashboard at: 127.0.0.1:34139 2837s 2024-11-24 00:51:09,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37315 2837s 2024-11-24 00:51:09,194 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:09,194 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:09,194 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:09,194 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-siibh0oy 2837s 2024-11-24 00:51:09,194 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:09,195 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38037 2837s 2024-11-24 00:51:09,195 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38037 2837s 2024-11-24 00:51:09,196 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:09,196 - distributed.worker - INFO - dashboard at: 127.0.0.1:35499 2837s 2024-11-24 00:51:09,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37315 2837s 2024-11-24 00:51:09,196 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:09,196 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:09,196 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:09,196 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x83zrvhl 2837s 2024-11-24 00:51:09,196 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:09,199 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44611. Reason: failure-to-start- 2837s 2024-11-24 00:51:09,200 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:09,200 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38037. Reason: failure-to-start- 2837s 2024-11-24 00:51:09,200 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:09,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37315': TLS handshake failed with remote 'tls://127.0.0.1:53546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:09,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37315': TLS handshake failed with remote 'tls://127.0.0.1:53554': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:09,203 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:10,208 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:10,213 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34743 2837s 2024-11-24 00:51:10,213 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38519/status 2837s 2024-11-24 00:51:10,213 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:10,223 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41903 2837s 2024-11-24 00:51:10,224 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41903 2837s 2024-11-24 00:51:10,224 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:10,224 - distributed.worker - INFO - dashboard at: 127.0.0.1:36321 2837s 2024-11-24 00:51:10,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34743 2837s 2024-11-24 00:51:10,224 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:10,224 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:10,224 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:10,224 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hyrydos4 2837s 2024-11-24 00:51:10,224 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:10,225 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45617 2837s 2024-11-24 00:51:10,225 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45617 2837s 2024-11-24 00:51:10,225 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:10,226 - distributed.worker - INFO - dashboard at: 127.0.0.1:42687 2837s 2024-11-24 00:51:10,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34743 2837s 2024-11-24 00:51:10,226 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:10,226 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:10,226 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:10,226 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c5y99r6r 2837s 2024-11-24 00:51:10,226 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:10,227 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41903. Reason: failure-to-start- 2837s 2024-11-24 00:51:10,227 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:10,227 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45617. Reason: failure-to-start- 2837s 2024-11-24 00:51:10,227 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:10,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34743': TLS handshake failed with remote 'tls://127.0.0.1:45942': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:10,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34743': TLS handshake failed with remote 'tls://127.0.0.1:45950': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:10,229 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:11,233 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:11,238 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45813 2837s 2024-11-24 00:51:11,238 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36157/status 2837s 2024-11-24 00:51:11,238 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:11,248 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39819 2837s 2024-11-24 00:51:11,248 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39819 2837s 2024-11-24 00:51:11,248 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:11,248 - distributed.worker - INFO - dashboard at: 127.0.0.1:46231 2837s 2024-11-24 00:51:11,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45813 2837s 2024-11-24 00:51:11,249 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:11,249 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:11,249 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:11,249 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xlqcmsao 2837s 2024-11-24 00:51:11,249 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:11,250 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34365 2837s 2024-11-24 00:51:11,251 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34365 2837s 2024-11-24 00:51:11,251 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:11,251 - distributed.worker - INFO - dashboard at: 127.0.0.1:40689 2837s 2024-11-24 00:51:11,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45813 2837s 2024-11-24 00:51:11,251 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:11,251 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:11,251 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:11,251 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3vewy9mk 2837s 2024-11-24 00:51:11,251 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:11,252 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39819. Reason: failure-to-start- 2837s 2024-11-24 00:51:11,252 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:11,252 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34365. Reason: failure-to-start- 2837s 2024-11-24 00:51:11,252 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:11,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45813': TLS handshake failed with remote 'tls://127.0.0.1:44660': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:11,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45813': TLS handshake failed with remote 'tls://127.0.0.1:44668': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:11,254 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:12,259 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:12,264 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34473 2837s 2024-11-24 00:51:12,264 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45437/status 2837s 2024-11-24 00:51:12,264 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:12,274 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37251 2837s 2024-11-24 00:51:12,274 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37251 2837s 2024-11-24 00:51:12,274 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:12,274 - distributed.worker - INFO - dashboard at: 127.0.0.1:34965 2837s 2024-11-24 00:51:12,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34473 2837s 2024-11-24 00:51:12,274 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:12,274 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:12,274 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:12,274 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k9j0uc2x 2837s 2024-11-24 00:51:12,274 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:12,276 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37305 2837s 2024-11-24 00:51:12,276 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37305 2837s 2024-11-24 00:51:12,276 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:12,276 - distributed.worker - INFO - dashboard at: 127.0.0.1:41327 2837s 2024-11-24 00:51:12,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34473 2837s 2024-11-24 00:51:12,276 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:12,276 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:12,277 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:12,277 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-chlvzni4 2837s 2024-11-24 00:51:12,277 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:12,277 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37251. Reason: failure-to-start- 2837s 2024-11-24 00:51:12,278 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:12,278 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37305. Reason: failure-to-start- 2837s 2024-11-24 00:51:12,278 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:12,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34473': TLS handshake failed with remote 'tls://127.0.0.1:37192': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:12,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34473': TLS handshake failed with remote 'tls://127.0.0.1:37202': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:12,280 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:13,284 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:13,295 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33217 2837s 2024-11-24 00:51:13,295 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38657/status 2837s 2024-11-24 00:51:13,295 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:13,305 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41763 2837s 2024-11-24 00:51:13,305 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41763 2837s 2024-11-24 00:51:13,305 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:13,305 - distributed.worker - INFO - dashboard at: 127.0.0.1:38673 2837s 2024-11-24 00:51:13,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33217 2837s 2024-11-24 00:51:13,305 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:13,305 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:13,305 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:13,305 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7m8o5iuw 2837s 2024-11-24 00:51:13,305 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:13,307 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37419 2837s 2024-11-24 00:51:13,307 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37419 2837s 2024-11-24 00:51:13,307 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:13,307 - distributed.worker - INFO - dashboard at: 127.0.0.1:42009 2837s 2024-11-24 00:51:13,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33217 2837s 2024-11-24 00:51:13,307 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:13,307 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:13,307 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:13,307 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pnxjvvs7 2837s 2024-11-24 00:51:13,307 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:13,308 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41763. Reason: failure-to-start- 2837s 2024-11-24 00:51:13,308 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:13,309 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37419. Reason: failure-to-start- 2837s 2024-11-24 00:51:13,309 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:13,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33217': TLS handshake failed with remote 'tls://127.0.0.1:44192': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:13,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33217': TLS handshake failed with remote 'tls://127.0.0.1:44200': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:13,311 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:14,315 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:14,320 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32993 2837s 2024-11-24 00:51:14,320 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43071/status 2837s 2024-11-24 00:51:14,320 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:14,330 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41409 2837s 2024-11-24 00:51:14,330 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41409 2837s 2024-11-24 00:51:14,330 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:14,330 - distributed.worker - INFO - dashboard at: 127.0.0.1:39343 2837s 2024-11-24 00:51:14,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32993 2837s 2024-11-24 00:51:14,330 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:14,330 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:14,331 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:14,331 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8ejb5oj_ 2837s 2024-11-24 00:51:14,331 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:14,332 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40679 2837s 2024-11-24 00:51:14,332 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40679 2837s 2024-11-24 00:51:14,332 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:14,332 - distributed.worker - INFO - dashboard at: 127.0.0.1:46835 2837s 2024-11-24 00:51:14,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32993 2837s 2024-11-24 00:51:14,332 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:14,332 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:14,332 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:14,332 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rj7_rqap 2837s 2024-11-24 00:51:14,332 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:14,333 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41409. Reason: failure-to-start- 2837s 2024-11-24 00:51:14,333 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:14,334 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40679. Reason: failure-to-start- 2837s 2024-11-24 00:51:14,334 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:14,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32993': TLS handshake failed with remote 'tls://127.0.0.1:43864': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:14,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32993': TLS handshake failed with remote 'tls://127.0.0.1:43870': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:14,336 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:15,340 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:15,345 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45103 2837s 2024-11-24 00:51:15,345 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39403/status 2837s 2024-11-24 00:51:15,345 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:15,354 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36457 2837s 2024-11-24 00:51:15,354 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36457 2837s 2024-11-24 00:51:15,354 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:15,354 - distributed.worker - INFO - dashboard at: 127.0.0.1:32917 2837s 2024-11-24 00:51:15,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45103 2837s 2024-11-24 00:51:15,354 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:15,354 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:15,354 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:15,355 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b_hfjp69 2837s 2024-11-24 00:51:15,355 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:15,356 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37801 2837s 2024-11-24 00:51:15,356 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37801 2837s 2024-11-24 00:51:15,356 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:15,356 - distributed.worker - INFO - dashboard at: 127.0.0.1:45867 2837s 2024-11-24 00:51:15,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45103 2837s 2024-11-24 00:51:15,356 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:15,356 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:15,356 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:15,356 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o9pvovxe 2837s 2024-11-24 00:51:15,356 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:15,358 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36457. Reason: failure-to-start- 2837s 2024-11-24 00:51:15,358 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:15,358 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37801. Reason: failure-to-start- 2837s 2024-11-24 00:51:15,358 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:15,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45103': TLS handshake failed with remote 'tls://127.0.0.1:40006': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:15,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45103': TLS handshake failed with remote 'tls://127.0.0.1:40008': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:15,360 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:16,364 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:16,368 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41109 2837s 2024-11-24 00:51:16,369 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36965/status 2837s 2024-11-24 00:51:16,369 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:16,378 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33085 2837s 2024-11-24 00:51:16,378 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33085 2837s 2024-11-24 00:51:16,378 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:16,378 - distributed.worker - INFO - dashboard at: 127.0.0.1:40503 2837s 2024-11-24 00:51:16,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41109 2837s 2024-11-24 00:51:16,378 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:16,378 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:16,378 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:16,378 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4b6557jx 2837s 2024-11-24 00:51:16,379 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:16,380 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39757 2837s 2024-11-24 00:51:16,380 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39757 2837s 2024-11-24 00:51:16,380 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:16,380 - distributed.worker - INFO - dashboard at: 127.0.0.1:35719 2837s 2024-11-24 00:51:16,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41109 2837s 2024-11-24 00:51:16,380 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:16,380 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:16,380 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:16,380 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2yg22bzk 2837s 2024-11-24 00:51:16,380 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:16,381 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33085. Reason: failure-to-start- 2837s 2024-11-24 00:51:16,381 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:16,382 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39757. Reason: failure-to-start- 2837s 2024-11-24 00:51:16,382 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:16,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41109': TLS handshake failed with remote 'tls://127.0.0.1:44436': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:16,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41109': TLS handshake failed with remote 'tls://127.0.0.1:44452': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:16,384 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:17,388 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:17,394 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37955 2837s 2024-11-24 00:51:17,395 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34619/status 2837s 2024-11-24 00:51:17,395 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:17,404 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35273 2837s 2024-11-24 00:51:17,404 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35273 2837s 2024-11-24 00:51:17,404 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:17,404 - distributed.worker - INFO - dashboard at: 127.0.0.1:43109 2837s 2024-11-24 00:51:17,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37955 2837s 2024-11-24 00:51:17,404 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:17,404 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:17,404 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:17,405 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xf514n8w 2837s 2024-11-24 00:51:17,405 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:17,406 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45851 2837s 2024-11-24 00:51:17,406 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45851 2837s 2024-11-24 00:51:17,406 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:17,406 - distributed.worker - INFO - dashboard at: 127.0.0.1:46617 2837s 2024-11-24 00:51:17,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37955 2837s 2024-11-24 00:51:17,406 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:17,406 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:17,406 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:17,406 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-agbitnk9 2837s 2024-11-24 00:51:17,406 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:17,407 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35273. Reason: failure-to-start- 2837s 2024-11-24 00:51:17,407 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:17,408 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45851. Reason: failure-to-start- 2837s 2024-11-24 00:51:17,408 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:17,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37955': TLS handshake failed with remote 'tls://127.0.0.1:48812': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:17,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37955': TLS handshake failed with remote 'tls://127.0.0.1:48814': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:17,410 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:18,414 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:18,418 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35883 2837s 2024-11-24 00:51:18,419 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34691/status 2837s 2024-11-24 00:51:18,419 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:18,429 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33565 2837s 2024-11-24 00:51:18,430 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33565 2837s 2024-11-24 00:51:18,430 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:18,430 - distributed.worker - INFO - dashboard at: 127.0.0.1:35111 2837s 2024-11-24 00:51:18,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35883 2837s 2024-11-24 00:51:18,430 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:18,430 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:18,430 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:18,430 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jnnllcdn 2837s 2024-11-24 00:51:18,430 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:18,431 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41827 2837s 2024-11-24 00:51:18,432 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41827 2837s 2024-11-24 00:51:18,432 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:18,432 - distributed.worker - INFO - dashboard at: 127.0.0.1:37373 2837s 2024-11-24 00:51:18,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35883 2837s 2024-11-24 00:51:18,432 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:18,432 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:18,432 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:18,432 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1_g0yb7f 2837s 2024-11-24 00:51:18,432 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:18,433 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33565. Reason: failure-to-start- 2837s 2024-11-24 00:51:18,433 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:18,433 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41827. Reason: failure-to-start- 2837s 2024-11-24 00:51:18,433 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:18,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35883': TLS handshake failed with remote 'tls://127.0.0.1:58168': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:18,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35883': TLS handshake failed with remote 'tls://127.0.0.1:58180': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:18,435 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:19,440 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:19,444 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36195 2837s 2024-11-24 00:51:19,445 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39499/status 2837s 2024-11-24 00:51:19,445 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:19,454 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38587 2837s 2024-11-24 00:51:19,454 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38587 2837s 2024-11-24 00:51:19,454 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:19,454 - distributed.worker - INFO - dashboard at: 127.0.0.1:39433 2837s 2024-11-24 00:51:19,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36195 2837s 2024-11-24 00:51:19,454 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:19,454 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:19,454 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:19,454 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1xi83ply 2837s 2024-11-24 00:51:19,455 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:19,457 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45451 2837s 2024-11-24 00:51:19,457 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45451 2837s 2024-11-24 00:51:19,457 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:19,457 - distributed.worker - INFO - dashboard at: 127.0.0.1:37445 2837s 2024-11-24 00:51:19,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36195 2837s 2024-11-24 00:51:19,457 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:19,457 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:19,457 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:19,457 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-enc6byua 2837s 2024-11-24 00:51:19,457 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:19,459 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38587. Reason: failure-to-start- 2837s 2024-11-24 00:51:19,459 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:19,459 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45451. Reason: failure-to-start- 2837s 2024-11-24 00:51:19,460 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:19,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36195': TLS handshake failed with remote 'tls://127.0.0.1:56828': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:19,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36195': TLS handshake failed with remote 'tls://127.0.0.1:56840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:19,461 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:20,466 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:20,470 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41271 2837s 2024-11-24 00:51:20,471 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32933/status 2837s 2024-11-24 00:51:20,471 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:20,481 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36395 2837s 2024-11-24 00:51:20,481 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36395 2837s 2024-11-24 00:51:20,481 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:20,481 - distributed.worker - INFO - dashboard at: 127.0.0.1:38583 2837s 2024-11-24 00:51:20,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41271 2837s 2024-11-24 00:51:20,481 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:20,481 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:20,481 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:20,481 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yr8lsevt 2837s 2024-11-24 00:51:20,481 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:20,483 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35047 2837s 2024-11-24 00:51:20,483 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35047 2837s 2024-11-24 00:51:20,483 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:20,483 - distributed.worker - INFO - dashboard at: 127.0.0.1:43717 2837s 2024-11-24 00:51:20,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41271 2837s 2024-11-24 00:51:20,483 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:20,483 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:20,483 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:20,483 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5nprji5e 2837s 2024-11-24 00:51:20,483 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:20,484 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36395. Reason: failure-to-start- 2837s 2024-11-24 00:51:20,484 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:20,485 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35047. Reason: failure-to-start- 2837s 2024-11-24 00:51:20,485 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:20,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41271': TLS handshake failed with remote 'tls://127.0.0.1:51128': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:20,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41271': TLS handshake failed with remote 'tls://127.0.0.1:51140': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:20,487 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:21,491 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:21,495 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41273 2837s 2024-11-24 00:51:21,496 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34611/status 2837s 2024-11-24 00:51:21,496 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:21,505 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34543 2837s 2024-11-24 00:51:21,506 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34543 2837s 2024-11-24 00:51:21,506 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:21,506 - distributed.worker - INFO - dashboard at: 127.0.0.1:32883 2837s 2024-11-24 00:51:21,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41273 2837s 2024-11-24 00:51:21,506 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:21,506 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:21,506 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:21,506 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wp9eesrx 2837s 2024-11-24 00:51:21,506 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:21,508 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38787 2837s 2024-11-24 00:51:21,508 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38787 2837s 2024-11-24 00:51:21,508 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:21,508 - distributed.worker - INFO - dashboard at: 127.0.0.1:38737 2837s 2024-11-24 00:51:21,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41273 2837s 2024-11-24 00:51:21,508 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:21,508 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:21,508 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:21,508 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dtn4yb9c 2837s 2024-11-24 00:51:21,508 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:21,509 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34543. Reason: failure-to-start- 2837s 2024-11-24 00:51:21,509 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:21,509 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38787. Reason: failure-to-start- 2837s 2024-11-24 00:51:21,510 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:21,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41273': TLS handshake failed with remote 'tls://127.0.0.1:44694': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:21,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41273': TLS handshake failed with remote 'tls://127.0.0.1:44702': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:21,512 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:22,517 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:22,522 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43195 2837s 2024-11-24 00:51:22,523 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33759/status 2837s 2024-11-24 00:51:22,523 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:22,532 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45741 2837s 2024-11-24 00:51:22,532 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45741 2837s 2024-11-24 00:51:22,532 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:22,532 - distributed.worker - INFO - dashboard at: 127.0.0.1:40641 2837s 2024-11-24 00:51:22,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43195 2837s 2024-11-24 00:51:22,532 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:22,532 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:22,532 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:22,533 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e89e3uv6 2837s 2024-11-24 00:51:22,533 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:22,534 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37515 2837s 2024-11-24 00:51:22,534 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37515 2837s 2024-11-24 00:51:22,534 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:22,534 - distributed.worker - INFO - dashboard at: 127.0.0.1:44213 2837s 2024-11-24 00:51:22,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43195 2837s 2024-11-24 00:51:22,534 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:22,534 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:22,534 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:22,534 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m_655_m1 2837s 2024-11-24 00:51:22,534 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:22,535 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45741. Reason: failure-to-start- 2837s 2024-11-24 00:51:22,535 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:22,536 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37515. Reason: failure-to-start- 2837s 2024-11-24 00:51:22,536 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:22,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43195': TLS handshake failed with remote 'tls://127.0.0.1:44882': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:22,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43195': TLS handshake failed with remote 'tls://127.0.0.1:44886': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:22,538 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:23,543 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:23,547 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43005 2837s 2024-11-24 00:51:23,548 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45023/status 2837s 2024-11-24 00:51:23,548 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:23,567 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45241 2837s 2024-11-24 00:51:23,567 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45241 2837s 2024-11-24 00:51:23,567 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:23,567 - distributed.worker - INFO - dashboard at: 127.0.0.1:39999 2837s 2024-11-24 00:51:23,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43005 2837s 2024-11-24 00:51:23,567 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:23,567 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:23,567 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:23,567 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vdd1bl3g 2837s 2024-11-24 00:51:23,567 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:23,568 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36461 2837s 2024-11-24 00:51:23,569 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36461 2837s 2024-11-24 00:51:23,569 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:23,569 - distributed.worker - INFO - dashboard at: 127.0.0.1:36459 2837s 2024-11-24 00:51:23,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43005 2837s 2024-11-24 00:51:23,569 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:23,569 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:23,569 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:23,569 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vqgw9f8c 2837s 2024-11-24 00:51:23,569 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:23,571 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45241. Reason: failure-to-start- 2837s 2024-11-24 00:51:23,571 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:23,571 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36461. Reason: failure-to-start- 2837s 2024-11-24 00:51:23,571 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:23,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43005': TLS handshake failed with remote 'tls://127.0.0.1:52086': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:23,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43005': TLS handshake failed with remote 'tls://127.0.0.1:52098': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:23,573 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:24,578 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:24,583 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36799 2837s 2024-11-24 00:51:24,584 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45599/status 2837s 2024-11-24 00:51:24,584 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:24,594 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36499 2837s 2024-11-24 00:51:24,594 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36499 2837s 2024-11-24 00:51:24,594 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:24,594 - distributed.worker - INFO - dashboard at: 127.0.0.1:42013 2837s 2024-11-24 00:51:24,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36799 2837s 2024-11-24 00:51:24,594 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:24,595 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:24,595 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:24,595 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-axdgjplh 2837s 2024-11-24 00:51:24,595 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:24,596 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38815 2837s 2024-11-24 00:51:24,596 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38815 2837s 2024-11-24 00:51:24,596 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:24,596 - distributed.worker - INFO - dashboard at: 127.0.0.1:36759 2837s 2024-11-24 00:51:24,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36799 2837s 2024-11-24 00:51:24,596 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:24,596 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:24,597 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:24,597 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ea42ytay 2837s 2024-11-24 00:51:24,597 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:24,598 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36499. Reason: failure-to-start- 2837s 2024-11-24 00:51:24,599 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:24,599 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38815. Reason: failure-to-start- 2837s 2024-11-24 00:51:24,599 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:24,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36799': TLS handshake failed with remote 'tls://127.0.0.1:42610': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:24,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36799': TLS handshake failed with remote 'tls://127.0.0.1:42616': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:24,601 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:25,607 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:25,611 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45093 2837s 2024-11-24 00:51:25,612 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45469/status 2837s 2024-11-24 00:51:25,613 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:25,621 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36801 2837s 2024-11-24 00:51:25,622 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36801 2837s 2024-11-24 00:51:25,622 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:25,622 - distributed.worker - INFO - dashboard at: 127.0.0.1:33871 2837s 2024-11-24 00:51:25,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45093 2837s 2024-11-24 00:51:25,622 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:25,622 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:25,622 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:25,622 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-is7kuhdg 2837s 2024-11-24 00:51:25,622 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:25,623 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33595 2837s 2024-11-24 00:51:25,623 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33595 2837s 2024-11-24 00:51:25,623 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:25,623 - distributed.worker - INFO - dashboard at: 127.0.0.1:46135 2837s 2024-11-24 00:51:25,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45093 2837s 2024-11-24 00:51:25,623 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:25,623 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:25,624 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:25,624 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uzwo1jd5 2837s 2024-11-24 00:51:25,624 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:25,624 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36801. Reason: failure-to-start- 2837s 2024-11-24 00:51:25,625 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:25,625 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33595. Reason: failure-to-start- 2837s 2024-11-24 00:51:25,625 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:25,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45093': TLS handshake failed with remote 'tls://127.0.0.1:54194': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:25,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45093': TLS handshake failed with remote 'tls://127.0.0.1:54196': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:25,627 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:26,632 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:26,637 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46537 2837s 2024-11-24 00:51:26,637 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34859/status 2837s 2024-11-24 00:51:26,638 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:26,647 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33487 2837s 2024-11-24 00:51:26,647 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33487 2837s 2024-11-24 00:51:26,647 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:26,647 - distributed.worker - INFO - dashboard at: 127.0.0.1:35373 2837s 2024-11-24 00:51:26,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46537 2837s 2024-11-24 00:51:26,647 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:26,647 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:26,647 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:26,647 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zjhc88vz 2837s 2024-11-24 00:51:26,647 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:26,649 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45589 2837s 2024-11-24 00:51:26,649 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45589 2837s 2024-11-24 00:51:26,649 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:26,649 - distributed.worker - INFO - dashboard at: 127.0.0.1:42795 2837s 2024-11-24 00:51:26,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46537 2837s 2024-11-24 00:51:26,649 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:26,649 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:26,649 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:26,649 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mfe0r5oj 2837s 2024-11-24 00:51:26,649 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:26,650 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33487. Reason: failure-to-start- 2837s 2024-11-24 00:51:26,650 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:26,650 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45589. Reason: failure-to-start- 2837s 2024-11-24 00:51:26,650 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:26,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46537': TLS handshake failed with remote 'tls://127.0.0.1:55664': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:26,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46537': TLS handshake failed with remote 'tls://127.0.0.1:55676': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:26,652 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:27,657 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:27,661 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44129 2837s 2024-11-24 00:51:27,661 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37445/status 2837s 2024-11-24 00:51:27,662 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:27,673 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35685 2837s 2024-11-24 00:51:27,673 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35685 2837s 2024-11-24 00:51:27,673 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:27,673 - distributed.worker - INFO - dashboard at: 127.0.0.1:44083 2837s 2024-11-24 00:51:27,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44129 2837s 2024-11-24 00:51:27,673 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:27,673 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:27,673 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:27,674 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ze33d98i 2837s 2024-11-24 00:51:27,674 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:27,675 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37863 2837s 2024-11-24 00:51:27,675 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37863 2837s 2024-11-24 00:51:27,675 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:27,675 - distributed.worker - INFO - dashboard at: 127.0.0.1:40249 2837s 2024-11-24 00:51:27,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44129 2837s 2024-11-24 00:51:27,675 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:27,675 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:27,675 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:27,675 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xbu1j12c 2837s 2024-11-24 00:51:27,675 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:27,676 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35685. Reason: failure-to-start- 2837s 2024-11-24 00:51:27,676 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:27,677 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37863. Reason: failure-to-start- 2837s 2024-11-24 00:51:27,677 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:27,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44129': TLS handshake failed with remote 'tls://127.0.0.1:41546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:27,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44129': TLS handshake failed with remote 'tls://127.0.0.1:41554': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:27,679 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:28,684 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:28,689 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46151 2837s 2024-11-24 00:51:28,689 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40517/status 2837s 2024-11-24 00:51:28,689 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:28,699 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44577 2837s 2024-11-24 00:51:28,699 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44577 2837s 2024-11-24 00:51:28,700 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:28,700 - distributed.worker - INFO - dashboard at: 127.0.0.1:33025 2837s 2024-11-24 00:51:28,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46151 2837s 2024-11-24 00:51:28,700 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:28,700 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:28,700 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:28,700 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mwjq8e_5 2837s 2024-11-24 00:51:28,700 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:28,701 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41707 2837s 2024-11-24 00:51:28,701 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41707 2837s 2024-11-24 00:51:28,701 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:28,701 - distributed.worker - INFO - dashboard at: 127.0.0.1:43569 2837s 2024-11-24 00:51:28,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46151 2837s 2024-11-24 00:51:28,701 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:28,701 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:28,701 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:28,702 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kh76675r 2837s 2024-11-24 00:51:28,702 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:28,703 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44577. Reason: failure-to-start- 2837s 2024-11-24 00:51:28,704 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:28,704 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41707. Reason: failure-to-start- 2837s 2024-11-24 00:51:28,704 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:28,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46151': TLS handshake failed with remote 'tls://127.0.0.1:40300': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:28,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46151': TLS handshake failed with remote 'tls://127.0.0.1:40314': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:28,706 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:29,710 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:29,714 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45155 2837s 2024-11-24 00:51:29,715 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36731/status 2837s 2024-11-24 00:51:29,715 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:29,725 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44681 2837s 2024-11-24 00:51:29,725 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44681 2837s 2024-11-24 00:51:29,725 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:29,725 - distributed.worker - INFO - dashboard at: 127.0.0.1:45111 2837s 2024-11-24 00:51:29,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45155 2837s 2024-11-24 00:51:29,725 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:29,725 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:29,725 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:29,725 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5i5jyyfj 2837s 2024-11-24 00:51:29,725 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:29,727 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33219 2837s 2024-11-24 00:51:29,727 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33219 2837s 2024-11-24 00:51:29,727 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:29,727 - distributed.worker - INFO - dashboard at: 127.0.0.1:33907 2837s 2024-11-24 00:51:29,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45155 2837s 2024-11-24 00:51:29,727 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:29,727 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:29,727 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:29,727 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sxj7c3wc 2837s 2024-11-24 00:51:29,727 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:29,728 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44681. Reason: failure-to-start- 2837s 2024-11-24 00:51:29,728 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:29,729 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33219. Reason: failure-to-start- 2837s 2024-11-24 00:51:29,729 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:29,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45155': TLS handshake failed with remote 'tls://127.0.0.1:49948': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:29,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45155': TLS handshake failed with remote 'tls://127.0.0.1:49956': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:29,730 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:51:30,734 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:30,740 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39203 2837s 2024-11-24 00:51:30,741 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45735/status 2837s 2024-11-24 00:51:30,741 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:30,751 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42349 2837s 2024-11-24 00:51:30,751 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42349 2837s 2024-11-24 00:51:30,751 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:30,751 - distributed.worker - INFO - dashboard at: 127.0.0.1:37633 2837s 2024-11-24 00:51:30,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39203 2837s 2024-11-24 00:51:30,751 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:30,751 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:30,751 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:30,751 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wqvnruq7 2837s 2024-11-24 00:51:30,751 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:30,753 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45569 2837s 2024-11-24 00:51:30,753 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45569 2837s 2024-11-24 00:51:30,753 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:30,753 - distributed.worker - INFO - dashboard at: 127.0.0.1:46451 2837s 2024-11-24 00:51:30,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39203 2837s 2024-11-24 00:51:30,753 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:30,753 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:30,753 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:30,753 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yzkoa4r7 2837s 2024-11-24 00:51:30,753 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:30,754 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42349. Reason: failure-to-start- 2837s 2024-11-24 00:51:30,754 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:30,754 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45569. Reason: failure-to-start- 2837s 2024-11-24 00:51:30,755 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:30,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39203': TLS handshake failed with remote 'tls://127.0.0.1:57604': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:30,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39203': TLS handshake failed with remote 'tls://127.0.0.1:57606': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:51:30,756 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s ______________________________ test_worker_client ______________________________ 2837s 2837s fut = , timeout = 0 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 2837s await self._register_with_scheduler() 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2837s comm = await wait_for( 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2837s return await fut 2837s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 2837s stream = await self.client.connect( 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s host = '127.0.0.1', port = 39475, af = 2837s ssl_options = 2837s max_buffer_size = 4151066624.0, source_ip = None, source_port = None 2837s timeout = None 2837s 2837s async def connect( 2837s self, 2837s host: str, 2837s port: int, 2837s af: socket.AddressFamily = socket.AF_UNSPEC, 2837s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 2837s max_buffer_size: Optional[int] = None, 2837s source_ip: Optional[str] = None, 2837s source_port: Optional[int] = None, 2837s timeout: Optional[Union[float, datetime.timedelta]] = None, 2837s ) -> IOStream: 2837s """Connect to the given host and port. 2837s 2837s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 2837s ``ssl_options`` is not None). 2837s 2837s Using the ``source_ip`` kwarg, one can specify the source 2837s IP address to use when establishing the connection. 2837s In case the user needs to resolve and 2837s use a specific interface, it has to be handled outside 2837s of Tornado as this depends very much on the platform. 2837s 2837s Raises `TimeoutError` if the input future does not complete before 2837s ``timeout``, which may be specified in any form allowed by 2837s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 2837s relative to `.IOLoop.time`) 2837s 2837s Similarly, when the user requires a certain source port, it can 2837s be specified using the ``source_port`` arg. 2837s 2837s .. versionchanged:: 4.5 2837s Added the ``source_ip`` and ``source_port`` arguments. 2837s 2837s .. versionchanged:: 5.0 2837s Added the ``timeout`` argument. 2837s """ 2837s if timeout is not None: 2837s if isinstance(timeout, numbers.Real): 2837s timeout = IOLoop.current().time() + timeout 2837s elif isinstance(timeout, datetime.timedelta): 2837s timeout = IOLoop.current().time() + timeout.total_seconds() 2837s else: 2837s raise TypeError("Unsupported timeout %r" % timeout) 2837s if timeout is not None: 2837s addrinfo = await gen.with_timeout( 2837s timeout, self.resolver.resolve(host, port, af) 2837s ) 2837s else: 2837s addrinfo = await self.resolver.resolve(host, port, af) 2837s connector = _Connector( 2837s addrinfo, 2837s functools.partial( 2837s self._create_stream, 2837s max_buffer_size, 2837s source_ip=source_ip, 2837s source_port=source_port, 2837s ), 2837s ) 2837s > af, addr, stream = await connector.start(connect_timeout=timeout) 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s > await wait_for(self.start_unsafe(), timeout=timeout) 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:664: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s @contextlib.asynccontextmanager 2837s async def _cluster_factory(): 2837s workers = [] 2837s s = None 2837s try: 2837s for _ in range(60): 2837s try: 2837s > s, ws = await start_cluster( 2837s nthreads, 2837s scheduler, 2837s security=security, 2837s Worker=Worker, 2837s scheduler_kwargs=scheduler_kwargs, 2837s worker_kwargs=merge( 2837s {"death_timeout": min(15, int(deadline.remaining))}, 2837s worker_kwargs, 2837s ), 2837s ) 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 2837s await asyncio.gather(*workers) 2837s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 2837s return await awaitable 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s except asyncio.TimeoutError as exc: 2837s await _close_on_failure(exc) 2837s > raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s E TimeoutError: Worker start timed out after 0s. 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s fut = ._..test_func..async_fn at 0xe63f7717a2b0> 2837s timeout = 60 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 2837s _cluster_factory() as (s, workers), 2837s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 2837s return await anext(self.gen) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 2837s await asyncio.sleep(1) 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s delay = 1, result = None 2837s 2837s async def sleep(delay, result=None): 2837s """Coroutine that completes after a given time (in seconds).""" 2837s if delay <= 0: 2837s await __sleep0() 2837s return result 2837s 2837s if math.isnan(delay): 2837s raise ValueError("Invalid delay: NaN (not a number)") 2837s 2837s loop = events.get_running_loop() 2837s future = loop.create_future() 2837s h = loop.call_later(delay, 2837s futures._set_result_unless_cancelled, 2837s future, result) 2837s try: 2837s > return await future 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s args = (), kwds = {} 2837s 2837s @wraps(func) 2837s def inner(*args, **kwds): 2837s with self._recreate_cm(): 2837s > return func(*args, **kwds) 2837s 2837s /usr/lib/python3.13/contextlib.py:85: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3.13/contextlib.py:85: in inner 2837s return func(*args, **kwds) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 2837s return _run_and_close_tornado(async_fn_outer) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 2837s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 2837s /usr/lib/python3.13/asyncio/runners.py:194: in run 2837s return runner.run(main) 2837s /usr/lib/python3.13/asyncio/runners.py:118: in run 2837s return self._loop.run_until_complete(task) 2837s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 2837s return future.result() 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 2837s return await async_fn(*args, **kwargs) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 2837s return await utils_wait_for(async_fn(), timeout=timeout * 2) 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s ----------------------------- Captured stderr call ----------------------------- 2837s 2024-11-24 00:51:31,835 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:31,839 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:31,839 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32789/status 2837s 2024-11-24 00:51:31,839 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:31,847 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44315 2837s 2024-11-24 00:51:31,847 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44315 2837s 2024-11-24 00:51:31,847 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:31,847 - distributed.worker - INFO - dashboard at: 127.0.0.1:37149 2837s 2024-11-24 00:51:31,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:31,847 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:31,847 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:51:31,847 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:31,847 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4iwuaih4 2837s 2024-11-24 00:51:31,847 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:31,849 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39031 2837s 2024-11-24 00:51:31,849 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39031 2837s 2024-11-24 00:51:31,849 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:31,849 - distributed.worker - INFO - dashboard at: 127.0.0.1:35447 2837s 2024-11-24 00:51:31,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:31,849 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:31,849 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:31,849 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:31,849 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qz6m9tj0 2837s 2024-11-24 00:51:31,849 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:31,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:31,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:31,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:31,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:31,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:31,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:31,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:31,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:32,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:32,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:33,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:33,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:56992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:57004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:57012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:57026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:57028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:34,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:57040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:34,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:57042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:57044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:57058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:57064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:57074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:35,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:35,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:36,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:36,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:37,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:37,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:38,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:38,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:54998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:39,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:39,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:40,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:40,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:41,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:41,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:41,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:41,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:41,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:41,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:41,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:41,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:41,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:41,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:41,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:41,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:41,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:41,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:41,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:41,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:41,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:41,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:41,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:41,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:41,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:41,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:41,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:41,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:41,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:41,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:41,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:41,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:41,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:41,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:41,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:41,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:42,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:42,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:43,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:43,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:44,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:44,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:55848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:45,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:45,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:46,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:46,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:46,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:46,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:46,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:46,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:46,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:46,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:46,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:46,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:46,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:46,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:46,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:46,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:46,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:46,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:46,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:46,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:46,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:46,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:46,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:46,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:46,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:46,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:46,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:46,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:46,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:46,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:46,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:46,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:46,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 2837s 2024-11-24 00:51:46,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:58792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:46,846 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44315. Reason: failure-to-start- 2837s 2024-11-24 00:51:46,846 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:46,848 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 15s. 2837s 2024-11-24 00:51:46,851 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39031. Reason: failure-to-start- 2837s 2024-11-24 00:51:46,851 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:51:47,854 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:51:47,859 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:47,859 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40647/status 2837s 2024-11-24 00:51:47,859 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:51:47,868 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38525 2837s 2024-11-24 00:51:47,868 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38525 2837s 2024-11-24 00:51:47,868 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:51:47,868 - distributed.worker - INFO - dashboard at: 127.0.0.1:46045 2837s 2024-11-24 00:51:47,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:47,868 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:47,868 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:51:47,868 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:47,868 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uv9nulp7 2837s 2024-11-24 00:51:47,868 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:47,869 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37913 2837s 2024-11-24 00:51:47,870 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37913 2837s 2024-11-24 00:51:47,870 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:51:47,870 - distributed.worker - INFO - dashboard at: 127.0.0.1:37895 2837s 2024-11-24 00:51:47,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:47,870 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:47,870 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:51:47,870 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:51:47,870 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-79phc1tk 2837s 2024-11-24 00:51:47,870 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:51:47,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:47,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:47,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:33884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:47,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:33890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:47,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:47,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:47,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:33906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:47,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:33914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:33926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:33942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:33952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:33960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:33968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:33970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:33986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:48,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:48,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:49,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:49,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:50,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:50,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:51,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:51,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:51,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:51,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:51,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:51,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:51,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:51,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:51,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:51,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:51,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:51,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:51,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:51,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:51,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:51,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:51,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:51,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:51,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:51,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:51,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:51,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:51,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:51,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:51,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:51,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:51,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:51,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:51,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:51,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:51,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:51,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:51,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:51,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:52,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:52,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:52,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:52,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:52,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:52,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:52,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:52,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:52,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:52,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:52,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:52,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:52,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:52,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:52,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:52,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:52,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:52,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:52,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:52,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:52,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:52,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:52,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:52,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:52,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:52,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:52,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:52,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:52,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:52,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:52,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:52,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:52,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:52,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:53,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:53,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:54,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:54,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:35146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:55,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:55,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:56,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:56,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:57,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:57,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:58,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:58,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:51:59,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:51:59,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:00,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:52:00,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:52:00,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:00,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:00,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:52:00,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:52:00,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:00,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:00,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:52:00,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:52:00,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:00,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:00,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:52:00,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:52:00,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:00,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:00,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:52:00,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:52:00,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:00,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:00,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:52:00,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:52:00,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:00,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:00,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:52:00,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:52:00,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:00,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:00,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:52:00,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44931 2837s 2024-11-24 00:52:00,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:00,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:43978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:00,867 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38525. Reason: failure-to-start- 2837s 2024-11-24 00:52:00,867 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:00,868 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 13s. 2837s 2024-11-24 00:52:00,871 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37913. Reason: failure-to-start- 2837s 2024-11-24 00:52:00,872 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:01,874 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:01,877 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41419 2837s 2024-11-24 00:52:01,878 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45427/status 2837s 2024-11-24 00:52:01,878 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:01,885 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45013 2837s 2024-11-24 00:52:01,885 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45013 2837s 2024-11-24 00:52:01,885 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:01,885 - distributed.worker - INFO - dashboard at: 127.0.0.1:33121 2837s 2024-11-24 00:52:01,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41419 2837s 2024-11-24 00:52:01,885 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:01,885 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:01,886 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:01,886 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-13piu7xi 2837s 2024-11-24 00:52:01,886 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:01,887 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35411 2837s 2024-11-24 00:52:01,887 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35411 2837s 2024-11-24 00:52:01,887 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:01,887 - distributed.worker - INFO - dashboard at: 127.0.0.1:46611 2837s 2024-11-24 00:52:01,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41419 2837s 2024-11-24 00:52:01,887 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:01,887 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:01,887 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:01,887 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p5x3fila 2837s 2024-11-24 00:52:01,888 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:01,888 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45013. Reason: failure-to-start- 2837s 2024-11-24 00:52:01,888 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:01,889 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35411. Reason: failure-to-start- 2837s 2024-11-24 00:52:01,889 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:01,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41419': TLS handshake failed with remote 'tls://127.0.0.1:34232': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:01,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41419': TLS handshake failed with remote 'tls://127.0.0.1:34244': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:01,891 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:02,897 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:02,901 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45985 2837s 2024-11-24 00:52:02,902 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35507/status 2837s 2024-11-24 00:52:02,902 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:02,909 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37209 2837s 2024-11-24 00:52:02,910 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37209 2837s 2024-11-24 00:52:02,910 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:02,910 - distributed.worker - INFO - dashboard at: 127.0.0.1:38515 2837s 2024-11-24 00:52:02,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45985 2837s 2024-11-24 00:52:02,910 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:02,910 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:02,910 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:02,910 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1y5vz8g2 2837s 2024-11-24 00:52:02,910 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:02,911 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45585 2837s 2024-11-24 00:52:02,911 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45585 2837s 2024-11-24 00:52:02,911 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:02,911 - distributed.worker - INFO - dashboard at: 127.0.0.1:37231 2837s 2024-11-24 00:52:02,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45985 2837s 2024-11-24 00:52:02,912 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:02,912 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:02,912 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:02,912 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qsfk5wqy 2837s 2024-11-24 00:52:02,912 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:02,912 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37209. Reason: failure-to-start- 2837s 2024-11-24 00:52:02,912 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:02,913 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45585. Reason: failure-to-start- 2837s 2024-11-24 00:52:02,913 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:02,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45985': TLS handshake failed with remote 'tls://127.0.0.1:47896': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:02,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45985': TLS handshake failed with remote 'tls://127.0.0.1:47910': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:02,915 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:03,920 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:03,923 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44925 2837s 2024-11-24 00:52:03,923 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36049/status 2837s 2024-11-24 00:52:03,924 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:03,932 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46607 2837s 2024-11-24 00:52:03,933 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46607 2837s 2024-11-24 00:52:03,933 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:03,933 - distributed.worker - INFO - dashboard at: 127.0.0.1:36125 2837s 2024-11-24 00:52:03,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44925 2837s 2024-11-24 00:52:03,933 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:03,933 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:03,933 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:03,933 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ltz7bnnj 2837s 2024-11-24 00:52:03,933 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:03,934 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35183 2837s 2024-11-24 00:52:03,934 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35183 2837s 2024-11-24 00:52:03,934 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:03,935 - distributed.worker - INFO - dashboard at: 127.0.0.1:36299 2837s 2024-11-24 00:52:03,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44925 2837s 2024-11-24 00:52:03,935 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:03,935 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:03,935 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:03,935 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-irvztltv 2837s 2024-11-24 00:52:03,935 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:03,935 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46607. Reason: failure-to-start- 2837s 2024-11-24 00:52:03,935 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:03,936 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35183. Reason: failure-to-start- 2837s 2024-11-24 00:52:03,936 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:03,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44925': TLS handshake failed with remote 'tls://127.0.0.1:44620': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:03,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44925': TLS handshake failed with remote 'tls://127.0.0.1:44626': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:03,938 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:04,943 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:04,946 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44805 2837s 2024-11-24 00:52:04,947 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41291/status 2837s 2024-11-24 00:52:04,947 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:04,954 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35279 2837s 2024-11-24 00:52:04,954 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35279 2837s 2024-11-24 00:52:04,954 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:04,954 - distributed.worker - INFO - dashboard at: 127.0.0.1:45079 2837s 2024-11-24 00:52:04,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44805 2837s 2024-11-24 00:52:04,955 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:04,955 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:04,955 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:04,955 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ws1j9_nk 2837s 2024-11-24 00:52:04,955 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:04,956 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36385 2837s 2024-11-24 00:52:04,956 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36385 2837s 2024-11-24 00:52:04,956 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:04,956 - distributed.worker - INFO - dashboard at: 127.0.0.1:46565 2837s 2024-11-24 00:52:04,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44805 2837s 2024-11-24 00:52:04,956 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:04,956 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:04,956 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:04,956 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-juq68b5x 2837s 2024-11-24 00:52:04,957 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:04,961 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35279. Reason: failure-to-start- 2837s 2024-11-24 00:52:04,961 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:04,962 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36385. Reason: failure-to-start- 2837s 2024-11-24 00:52:04,962 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:04,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44805': TLS handshake failed with remote 'tls://127.0.0.1:51976': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:04,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44805': TLS handshake failed with remote 'tls://127.0.0.1:51990': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:04,964 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:05,968 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:05,971 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45735 2837s 2024-11-24 00:52:05,972 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44275/status 2837s 2024-11-24 00:52:05,972 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:05,979 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39129 2837s 2024-11-24 00:52:05,979 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39129 2837s 2024-11-24 00:52:05,979 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:05,980 - distributed.worker - INFO - dashboard at: 127.0.0.1:45853 2837s 2024-11-24 00:52:05,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45735 2837s 2024-11-24 00:52:05,980 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:05,980 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:05,980 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:05,980 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0p8egz6v 2837s 2024-11-24 00:52:05,980 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:05,981 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45861 2837s 2024-11-24 00:52:05,981 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45861 2837s 2024-11-24 00:52:05,981 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:05,981 - distributed.worker - INFO - dashboard at: 127.0.0.1:37577 2837s 2024-11-24 00:52:05,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45735 2837s 2024-11-24 00:52:05,981 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:05,981 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:05,981 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:05,982 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8y2p8rn8 2837s 2024-11-24 00:52:05,982 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:05,982 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39129. Reason: failure-to-start- 2837s 2024-11-24 00:52:05,982 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:05,983 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45861. Reason: failure-to-start- 2837s 2024-11-24 00:52:05,983 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:05,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45735': TLS handshake failed with remote 'tls://127.0.0.1:40220': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:05,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45735': TLS handshake failed with remote 'tls://127.0.0.1:40232': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:05,985 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:06,990 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:06,994 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44345 2837s 2024-11-24 00:52:06,994 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44359/status 2837s 2024-11-24 00:52:06,994 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:07,003 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34737 2837s 2024-11-24 00:52:07,003 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34737 2837s 2024-11-24 00:52:07,003 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:07,003 - distributed.worker - INFO - dashboard at: 127.0.0.1:43155 2837s 2024-11-24 00:52:07,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44345 2837s 2024-11-24 00:52:07,003 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:07,003 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:07,003 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:07,003 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-duva8su8 2837s 2024-11-24 00:52:07,003 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:07,005 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34799 2837s 2024-11-24 00:52:07,005 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34799 2837s 2024-11-24 00:52:07,005 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:07,005 - distributed.worker - INFO - dashboard at: 127.0.0.1:40015 2837s 2024-11-24 00:52:07,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44345 2837s 2024-11-24 00:52:07,005 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:07,005 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:07,005 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:07,005 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w10qn5q7 2837s 2024-11-24 00:52:07,005 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:07,006 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34737. Reason: failure-to-start- 2837s 2024-11-24 00:52:07,006 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:07,006 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34799. Reason: failure-to-start- 2837s 2024-11-24 00:52:07,006 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:07,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44345': TLS handshake failed with remote 'tls://127.0.0.1:38760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:07,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44345': TLS handshake failed with remote 'tls://127.0.0.1:38766': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:07,008 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:08,013 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:08,017 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43793 2837s 2024-11-24 00:52:08,017 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36205/status 2837s 2024-11-24 00:52:08,017 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:08,026 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42583 2837s 2024-11-24 00:52:08,026 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42583 2837s 2024-11-24 00:52:08,026 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:08,026 - distributed.worker - INFO - dashboard at: 127.0.0.1:44697 2837s 2024-11-24 00:52:08,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43793 2837s 2024-11-24 00:52:08,026 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:08,026 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:08,026 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:08,026 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e7pc53aj 2837s 2024-11-24 00:52:08,027 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:08,028 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36733 2837s 2024-11-24 00:52:08,028 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36733 2837s 2024-11-24 00:52:08,028 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:08,028 - distributed.worker - INFO - dashboard at: 127.0.0.1:44471 2837s 2024-11-24 00:52:08,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43793 2837s 2024-11-24 00:52:08,028 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:08,028 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:08,028 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:08,028 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pvbx4ohe 2837s 2024-11-24 00:52:08,028 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:08,029 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42583. Reason: failure-to-start- 2837s 2024-11-24 00:52:08,029 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:08,030 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36733. Reason: failure-to-start- 2837s 2024-11-24 00:52:08,030 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:08,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43793': TLS handshake failed with remote 'tls://127.0.0.1:52182': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:08,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43793': TLS handshake failed with remote 'tls://127.0.0.1:52184': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:08,032 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:09,036 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:09,039 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39679 2837s 2024-11-24 00:52:09,040 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42931/status 2837s 2024-11-24 00:52:09,040 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:09,048 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44331 2837s 2024-11-24 00:52:09,048 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44331 2837s 2024-11-24 00:52:09,048 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:09,048 - distributed.worker - INFO - dashboard at: 127.0.0.1:36429 2837s 2024-11-24 00:52:09,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39679 2837s 2024-11-24 00:52:09,049 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:09,049 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:09,049 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:09,049 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4s158san 2837s 2024-11-24 00:52:09,049 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:09,050 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45421 2837s 2024-11-24 00:52:09,050 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45421 2837s 2024-11-24 00:52:09,050 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:09,050 - distributed.worker - INFO - dashboard at: 127.0.0.1:40127 2837s 2024-11-24 00:52:09,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39679 2837s 2024-11-24 00:52:09,050 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:09,050 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:09,050 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:09,051 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y18ipjvk 2837s 2024-11-24 00:52:09,051 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:09,052 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44331. Reason: failure-to-start- 2837s 2024-11-24 00:52:09,052 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:09,052 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45421. Reason: failure-to-start- 2837s 2024-11-24 00:52:09,052 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:09,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39679': TLS handshake failed with remote 'tls://127.0.0.1:51078': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:09,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39679': TLS handshake failed with remote 'tls://127.0.0.1:51084': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:09,054 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:10,059 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:10,063 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46429 2837s 2024-11-24 00:52:10,063 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33911/status 2837s 2024-11-24 00:52:10,063 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:10,071 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33049 2837s 2024-11-24 00:52:10,072 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33049 2837s 2024-11-24 00:52:10,072 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:10,072 - distributed.worker - INFO - dashboard at: 127.0.0.1:43889 2837s 2024-11-24 00:52:10,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46429 2837s 2024-11-24 00:52:10,072 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:10,072 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:10,072 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:10,072 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s0lxenpq 2837s 2024-11-24 00:52:10,072 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:10,074 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33445 2837s 2024-11-24 00:52:10,074 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33445 2837s 2024-11-24 00:52:10,074 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:10,074 - distributed.worker - INFO - dashboard at: 127.0.0.1:45823 2837s 2024-11-24 00:52:10,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46429 2837s 2024-11-24 00:52:10,074 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:10,074 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:10,074 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:10,074 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-itkq41wl 2837s 2024-11-24 00:52:10,074 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:10,075 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33049. Reason: failure-to-start- 2837s 2024-11-24 00:52:10,075 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:10,075 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33445. Reason: failure-to-start- 2837s 2024-11-24 00:52:10,075 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:10,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46429': TLS handshake failed with remote 'tls://127.0.0.1:54648': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:10,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46429': TLS handshake failed with remote 'tls://127.0.0.1:54664': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:10,077 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:11,082 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:11,087 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43935 2837s 2024-11-24 00:52:11,087 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39271/status 2837s 2024-11-24 00:52:11,087 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:11,095 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36715 2837s 2024-11-24 00:52:11,095 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36715 2837s 2024-11-24 00:52:11,095 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:11,095 - distributed.worker - INFO - dashboard at: 127.0.0.1:38501 2837s 2024-11-24 00:52:11,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43935 2837s 2024-11-24 00:52:11,095 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:11,095 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:11,095 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:11,095 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zbgknce0 2837s 2024-11-24 00:52:11,095 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:11,097 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42185 2837s 2024-11-24 00:52:11,097 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42185 2837s 2024-11-24 00:52:11,097 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:11,097 - distributed.worker - INFO - dashboard at: 127.0.0.1:41081 2837s 2024-11-24 00:52:11,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43935 2837s 2024-11-24 00:52:11,097 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:11,097 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:11,097 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:11,097 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3_xbiujn 2837s 2024-11-24 00:52:11,097 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:11,098 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36715. Reason: failure-to-start- 2837s 2024-11-24 00:52:11,098 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:11,098 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42185. Reason: failure-to-start- 2837s 2024-11-24 00:52:11,098 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:11,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43935': TLS handshake failed with remote 'tls://127.0.0.1:55678': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:11,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43935': TLS handshake failed with remote 'tls://127.0.0.1:55684': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:11,100 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:12,105 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:12,108 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36231 2837s 2024-11-24 00:52:12,109 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34733/status 2837s 2024-11-24 00:52:12,109 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:12,117 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37581 2837s 2024-11-24 00:52:12,118 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37581 2837s 2024-11-24 00:52:12,118 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:12,118 - distributed.worker - INFO - dashboard at: 127.0.0.1:46761 2837s 2024-11-24 00:52:12,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36231 2837s 2024-11-24 00:52:12,118 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:12,118 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:12,118 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:12,118 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0qsjg1qs 2837s 2024-11-24 00:52:12,118 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:12,119 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33113 2837s 2024-11-24 00:52:12,120 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33113 2837s 2024-11-24 00:52:12,120 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:12,120 - distributed.worker - INFO - dashboard at: 127.0.0.1:36567 2837s 2024-11-24 00:52:12,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36231 2837s 2024-11-24 00:52:12,120 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:12,120 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:12,120 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:12,120 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t7oqzx7d 2837s 2024-11-24 00:52:12,120 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:12,121 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37581. Reason: failure-to-start- 2837s 2024-11-24 00:52:12,121 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:12,121 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33113. Reason: failure-to-start- 2837s 2024-11-24 00:52:12,121 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:12,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36231': TLS handshake failed with remote 'tls://127.0.0.1:40536': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:12,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36231': TLS handshake failed with remote 'tls://127.0.0.1:40544': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:12,123 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:13,128 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:13,131 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44063 2837s 2024-11-24 00:52:13,131 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35571/status 2837s 2024-11-24 00:52:13,131 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:13,140 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36743 2837s 2024-11-24 00:52:13,140 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36743 2837s 2024-11-24 00:52:13,140 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:13,140 - distributed.worker - INFO - dashboard at: 127.0.0.1:39069 2837s 2024-11-24 00:52:13,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44063 2837s 2024-11-24 00:52:13,140 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:13,140 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:13,140 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:13,140 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b7ugylz9 2837s 2024-11-24 00:52:13,140 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:13,142 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39009 2837s 2024-11-24 00:52:13,143 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39009 2837s 2024-11-24 00:52:13,143 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:13,143 - distributed.worker - INFO - dashboard at: 127.0.0.1:41449 2837s 2024-11-24 00:52:13,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44063 2837s 2024-11-24 00:52:13,143 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:13,143 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:13,143 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:13,143 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xpr59hky 2837s 2024-11-24 00:52:13,143 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:13,144 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36743. Reason: failure-to-start- 2837s 2024-11-24 00:52:13,144 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:13,144 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39009. Reason: failure-to-start- 2837s 2024-11-24 00:52:13,144 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:13,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44063': TLS handshake failed with remote 'tls://127.0.0.1:57580': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:13,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44063': TLS handshake failed with remote 'tls://127.0.0.1:57590': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:13,146 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:14,150 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:14,154 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43687 2837s 2024-11-24 00:52:14,154 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34315/status 2837s 2024-11-24 00:52:14,155 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:14,163 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34643 2837s 2024-11-24 00:52:14,163 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34643 2837s 2024-11-24 00:52:14,163 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:14,163 - distributed.worker - INFO - dashboard at: 127.0.0.1:41777 2837s 2024-11-24 00:52:14,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43687 2837s 2024-11-24 00:52:14,163 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:14,163 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:14,163 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:14,163 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pz48d682 2837s 2024-11-24 00:52:14,163 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:14,165 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39061 2837s 2024-11-24 00:52:14,165 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39061 2837s 2024-11-24 00:52:14,165 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:14,165 - distributed.worker - INFO - dashboard at: 127.0.0.1:39249 2837s 2024-11-24 00:52:14,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43687 2837s 2024-11-24 00:52:14,165 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:14,165 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:14,165 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:14,165 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wlx96sfo 2837s 2024-11-24 00:52:14,165 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:14,167 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34643. Reason: failure-to-start- 2837s 2024-11-24 00:52:14,167 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:14,167 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39061. Reason: failure-to-start- 2837s 2024-11-24 00:52:14,167 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:14,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43687': TLS handshake failed with remote 'tls://127.0.0.1:46918': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:14,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43687': TLS handshake failed with remote 'tls://127.0.0.1:46932': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:14,169 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:15,173 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:15,177 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35421 2837s 2024-11-24 00:52:15,177 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37225/status 2837s 2024-11-24 00:52:15,177 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:15,185 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37425 2837s 2024-11-24 00:52:15,185 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37425 2837s 2024-11-24 00:52:15,185 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:15,185 - distributed.worker - INFO - dashboard at: 127.0.0.1:36461 2837s 2024-11-24 00:52:15,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35421 2837s 2024-11-24 00:52:15,185 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:15,185 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:15,185 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:15,185 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vaoxeb6v 2837s 2024-11-24 00:52:15,185 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:15,187 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33809 2837s 2024-11-24 00:52:15,187 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33809 2837s 2024-11-24 00:52:15,187 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:15,187 - distributed.worker - INFO - dashboard at: 127.0.0.1:33179 2837s 2024-11-24 00:52:15,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35421 2837s 2024-11-24 00:52:15,187 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:15,187 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:15,187 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:15,187 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wx4uncdj 2837s 2024-11-24 00:52:15,187 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:15,188 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37425. Reason: failure-to-start- 2837s 2024-11-24 00:52:15,188 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:15,188 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33809. Reason: failure-to-start- 2837s 2024-11-24 00:52:15,188 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:15,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35421': TLS handshake failed with remote 'tls://127.0.0.1:59726': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:15,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35421': TLS handshake failed with remote 'tls://127.0.0.1:59730': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:15,190 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:16,195 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:16,199 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40849 2837s 2024-11-24 00:52:16,199 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39695/status 2837s 2024-11-24 00:52:16,200 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:16,208 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36595 2837s 2024-11-24 00:52:16,208 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36595 2837s 2024-11-24 00:52:16,208 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:16,208 - distributed.worker - INFO - dashboard at: 127.0.0.1:43781 2837s 2024-11-24 00:52:16,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40849 2837s 2024-11-24 00:52:16,208 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:16,208 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:16,208 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:16,208 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xns35cx4 2837s 2024-11-24 00:52:16,208 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:16,210 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35875 2837s 2024-11-24 00:52:16,210 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35875 2837s 2024-11-24 00:52:16,210 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:16,210 - distributed.worker - INFO - dashboard at: 127.0.0.1:46419 2837s 2024-11-24 00:52:16,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40849 2837s 2024-11-24 00:52:16,210 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:16,210 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:16,210 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:16,210 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nbjfsfqj 2837s 2024-11-24 00:52:16,210 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:16,211 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36595. Reason: failure-to-start- 2837s 2024-11-24 00:52:16,211 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:16,212 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35875. Reason: failure-to-start- 2837s 2024-11-24 00:52:16,212 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:16,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40849': TLS handshake failed with remote 'tls://127.0.0.1:50812': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:16,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40849': TLS handshake failed with remote 'tls://127.0.0.1:50822': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:16,214 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:17,218 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:17,222 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34233 2837s 2024-11-24 00:52:17,222 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46349/status 2837s 2024-11-24 00:52:17,223 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:17,232 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43273 2837s 2024-11-24 00:52:17,232 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43273 2837s 2024-11-24 00:52:17,232 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:17,232 - distributed.worker - INFO - dashboard at: 127.0.0.1:39087 2837s 2024-11-24 00:52:17,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34233 2837s 2024-11-24 00:52:17,233 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:17,233 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:17,233 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:17,233 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jj97ocv9 2837s 2024-11-24 00:52:17,233 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:17,234 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43939 2837s 2024-11-24 00:52:17,234 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43939 2837s 2024-11-24 00:52:17,234 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:17,234 - distributed.worker - INFO - dashboard at: 127.0.0.1:40741 2837s 2024-11-24 00:52:17,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34233 2837s 2024-11-24 00:52:17,235 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:17,235 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:17,235 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:17,235 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xszspk78 2837s 2024-11-24 00:52:17,235 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:17,236 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43273. Reason: failure-to-start- 2837s 2024-11-24 00:52:17,236 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:17,236 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43939. Reason: failure-to-start- 2837s 2024-11-24 00:52:17,236 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:17,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34233': TLS handshake failed with remote 'tls://127.0.0.1:58920': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:17,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34233': TLS handshake failed with remote 'tls://127.0.0.1:58922': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:17,238 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:18,243 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:18,247 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34427 2837s 2024-11-24 00:52:18,247 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43833/status 2837s 2024-11-24 00:52:18,247 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:18,256 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34003 2837s 2024-11-24 00:52:18,256 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34003 2837s 2024-11-24 00:52:18,256 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:18,256 - distributed.worker - INFO - dashboard at: 127.0.0.1:36247 2837s 2024-11-24 00:52:18,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34427 2837s 2024-11-24 00:52:18,256 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:18,256 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:18,256 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:18,256 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e5zqmjuf 2837s 2024-11-24 00:52:18,256 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:18,258 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36805 2837s 2024-11-24 00:52:18,258 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36805 2837s 2024-11-24 00:52:18,258 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:18,258 - distributed.worker - INFO - dashboard at: 127.0.0.1:35315 2837s 2024-11-24 00:52:18,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34427 2837s 2024-11-24 00:52:18,258 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:18,258 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:18,258 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:18,258 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4hdzecp1 2837s 2024-11-24 00:52:18,258 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:18,259 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34003. Reason: failure-to-start- 2837s 2024-11-24 00:52:18,259 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:18,259 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36805. Reason: failure-to-start- 2837s 2024-11-24 00:52:18,259 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:18,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34427': TLS handshake failed with remote 'tls://127.0.0.1:55754': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:18,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34427': TLS handshake failed with remote 'tls://127.0.0.1:55758': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:18,262 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:19,266 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:19,270 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44099 2837s 2024-11-24 00:52:19,270 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34425/status 2837s 2024-11-24 00:52:19,270 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:19,278 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36693 2837s 2024-11-24 00:52:19,278 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36693 2837s 2024-11-24 00:52:19,278 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:19,278 - distributed.worker - INFO - dashboard at: 127.0.0.1:41963 2837s 2024-11-24 00:52:19,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44099 2837s 2024-11-24 00:52:19,278 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:19,278 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:19,278 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:19,278 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zkx5h_tb 2837s 2024-11-24 00:52:19,278 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:19,280 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35011 2837s 2024-11-24 00:52:19,280 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35011 2837s 2024-11-24 00:52:19,280 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:19,280 - distributed.worker - INFO - dashboard at: 127.0.0.1:42895 2837s 2024-11-24 00:52:19,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44099 2837s 2024-11-24 00:52:19,280 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:19,280 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:19,280 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:19,280 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jfaz2x_z 2837s 2024-11-24 00:52:19,280 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:19,282 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36693. Reason: failure-to-start- 2837s 2024-11-24 00:52:19,282 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:19,282 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35011. Reason: failure-to-start- 2837s 2024-11-24 00:52:19,282 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:19,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44099': TLS handshake failed with remote 'tls://127.0.0.1:54634': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:19,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44099': TLS handshake failed with remote 'tls://127.0.0.1:54642': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:19,284 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:20,289 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:20,293 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39127 2837s 2024-11-24 00:52:20,293 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46853/status 2837s 2024-11-24 00:52:20,293 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:20,301 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34359 2837s 2024-11-24 00:52:20,302 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34359 2837s 2024-11-24 00:52:20,302 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:20,302 - distributed.worker - INFO - dashboard at: 127.0.0.1:44009 2837s 2024-11-24 00:52:20,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39127 2837s 2024-11-24 00:52:20,302 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:20,302 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:20,302 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:20,302 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xli4hcxj 2837s 2024-11-24 00:52:20,302 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:20,303 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39543 2837s 2024-11-24 00:52:20,304 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39543 2837s 2024-11-24 00:52:20,304 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:20,304 - distributed.worker - INFO - dashboard at: 127.0.0.1:39323 2837s 2024-11-24 00:52:20,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39127 2837s 2024-11-24 00:52:20,304 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:20,304 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:20,304 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:20,304 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-izbhyhtd 2837s 2024-11-24 00:52:20,304 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:20,305 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34359. Reason: failure-to-start- 2837s 2024-11-24 00:52:20,305 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:20,305 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39543. Reason: failure-to-start- 2837s 2024-11-24 00:52:20,305 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:20,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39127': TLS handshake failed with remote 'tls://127.0.0.1:58514': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:20,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39127': TLS handshake failed with remote 'tls://127.0.0.1:58526': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:20,307 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:21,322 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:21,326 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46141 2837s 2024-11-24 00:52:21,326 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37371/status 2837s 2024-11-24 00:52:21,326 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:21,334 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39067 2837s 2024-11-24 00:52:21,334 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39067 2837s 2024-11-24 00:52:21,334 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:21,334 - distributed.worker - INFO - dashboard at: 127.0.0.1:44473 2837s 2024-11-24 00:52:21,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46141 2837s 2024-11-24 00:52:21,334 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:21,334 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:21,334 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:21,334 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i2znpzzb 2837s 2024-11-24 00:52:21,334 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:21,336 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44405 2837s 2024-11-24 00:52:21,336 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44405 2837s 2024-11-24 00:52:21,336 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:21,336 - distributed.worker - INFO - dashboard at: 127.0.0.1:37779 2837s 2024-11-24 00:52:21,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46141 2837s 2024-11-24 00:52:21,336 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:21,336 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:21,336 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:21,336 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j8lwh3ad 2837s 2024-11-24 00:52:21,336 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:21,337 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39067. Reason: failure-to-start- 2837s 2024-11-24 00:52:21,337 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:21,337 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44405. Reason: failure-to-start- 2837s 2024-11-24 00:52:21,337 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:21,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46141': TLS handshake failed with remote 'tls://127.0.0.1:40582': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:21,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46141': TLS handshake failed with remote 'tls://127.0.0.1:40586': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:21,339 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:22,343 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:22,347 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43435 2837s 2024-11-24 00:52:22,347 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35765/status 2837s 2024-11-24 00:52:22,347 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:22,357 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43015 2837s 2024-11-24 00:52:22,357 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43015 2837s 2024-11-24 00:52:22,357 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:22,357 - distributed.worker - INFO - dashboard at: 127.0.0.1:37629 2837s 2024-11-24 00:52:22,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43435 2837s 2024-11-24 00:52:22,357 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:22,357 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:22,357 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:22,357 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ay5oqlo2 2837s 2024-11-24 00:52:22,358 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:22,359 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33955 2837s 2024-11-24 00:52:22,359 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33955 2837s 2024-11-24 00:52:22,359 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:22,359 - distributed.worker - INFO - dashboard at: 127.0.0.1:42081 2837s 2024-11-24 00:52:22,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43435 2837s 2024-11-24 00:52:22,359 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:22,359 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:22,359 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:22,359 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rnrpjw5n 2837s 2024-11-24 00:52:22,359 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:22,360 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43015. Reason: failure-to-start- 2837s 2024-11-24 00:52:22,360 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:22,361 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33955. Reason: failure-to-start- 2837s 2024-11-24 00:52:22,361 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:22,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43435': TLS handshake failed with remote 'tls://127.0.0.1:57770': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:22,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43435': TLS handshake failed with remote 'tls://127.0.0.1:57776': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:22,364 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:23,368 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:23,372 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33463 2837s 2024-11-24 00:52:23,372 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42359/status 2837s 2024-11-24 00:52:23,372 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:23,380 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33313 2837s 2024-11-24 00:52:23,380 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33313 2837s 2024-11-24 00:52:23,380 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:23,381 - distributed.worker - INFO - dashboard at: 127.0.0.1:43129 2837s 2024-11-24 00:52:23,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33463 2837s 2024-11-24 00:52:23,381 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:23,382 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:23,382 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:23,382 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iz45fma3 2837s 2024-11-24 00:52:23,382 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:23,383 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41055 2837s 2024-11-24 00:52:23,383 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41055 2837s 2024-11-24 00:52:23,383 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:23,383 - distributed.worker - INFO - dashboard at: 127.0.0.1:38803 2837s 2024-11-24 00:52:23,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33463 2837s 2024-11-24 00:52:23,384 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:23,384 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:23,384 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:23,384 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8aplad9p 2837s 2024-11-24 00:52:23,384 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:23,385 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33313. Reason: failure-to-start- 2837s 2024-11-24 00:52:23,385 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:23,386 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41055. Reason: failure-to-start- 2837s 2024-11-24 00:52:23,386 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:23,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33463': TLS handshake failed with remote 'tls://127.0.0.1:39466': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:23,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33463': TLS handshake failed with remote 'tls://127.0.0.1:39468': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:23,388 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:24,392 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:24,396 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42299 2837s 2024-11-24 00:52:24,396 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40273/status 2837s 2024-11-24 00:52:24,396 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:24,404 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33651 2837s 2024-11-24 00:52:24,404 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33651 2837s 2024-11-24 00:52:24,404 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:24,404 - distributed.worker - INFO - dashboard at: 127.0.0.1:35961 2837s 2024-11-24 00:52:24,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42299 2837s 2024-11-24 00:52:24,404 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:24,404 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:24,404 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:24,405 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rryo29kw 2837s 2024-11-24 00:52:24,405 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:24,406 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33709 2837s 2024-11-24 00:52:24,406 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33709 2837s 2024-11-24 00:52:24,406 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:24,406 - distributed.worker - INFO - dashboard at: 127.0.0.1:46725 2837s 2024-11-24 00:52:24,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42299 2837s 2024-11-24 00:52:24,406 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:24,406 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:24,406 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:24,406 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ske3lsm3 2837s 2024-11-24 00:52:24,406 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:24,408 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33651. Reason: failure-to-start- 2837s 2024-11-24 00:52:24,408 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:24,408 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33709. Reason: failure-to-start- 2837s 2024-11-24 00:52:24,409 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:24,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42299': TLS handshake failed with remote 'tls://127.0.0.1:49182': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:24,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42299': TLS handshake failed with remote 'tls://127.0.0.1:49186': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:24,411 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:25,416 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:25,419 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36597 2837s 2024-11-24 00:52:25,420 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38773/status 2837s 2024-11-24 00:52:25,420 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:25,427 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38897 2837s 2024-11-24 00:52:25,428 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38897 2837s 2024-11-24 00:52:25,428 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:25,428 - distributed.worker - INFO - dashboard at: 127.0.0.1:40283 2837s 2024-11-24 00:52:25,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36597 2837s 2024-11-24 00:52:25,428 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:25,428 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:25,428 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:25,428 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i62k5wj3 2837s 2024-11-24 00:52:25,428 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:25,429 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38245 2837s 2024-11-24 00:52:25,429 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38245 2837s 2024-11-24 00:52:25,430 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:25,430 - distributed.worker - INFO - dashboard at: 127.0.0.1:33061 2837s 2024-11-24 00:52:25,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36597 2837s 2024-11-24 00:52:25,430 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:25,430 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:25,430 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:25,430 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sw4p8npo 2837s 2024-11-24 00:52:25,430 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:25,432 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38897. Reason: failure-to-start- 2837s 2024-11-24 00:52:25,432 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:25,432 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38245. Reason: failure-to-start- 2837s 2024-11-24 00:52:25,432 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:25,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36597': TLS handshake failed with remote 'tls://127.0.0.1:50458': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:25,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36597': TLS handshake failed with remote 'tls://127.0.0.1:50466': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:25,434 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:26,438 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:26,446 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43477 2837s 2024-11-24 00:52:26,446 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33847/status 2837s 2024-11-24 00:52:26,447 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:26,455 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35929 2837s 2024-11-24 00:52:26,455 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35929 2837s 2024-11-24 00:52:26,455 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:26,455 - distributed.worker - INFO - dashboard at: 127.0.0.1:43495 2837s 2024-11-24 00:52:26,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43477 2837s 2024-11-24 00:52:26,455 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:26,455 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:26,455 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:26,455 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fnth8jb_ 2837s 2024-11-24 00:52:26,455 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:26,457 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34279 2837s 2024-11-24 00:52:26,457 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34279 2837s 2024-11-24 00:52:26,457 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:26,457 - distributed.worker - INFO - dashboard at: 127.0.0.1:38741 2837s 2024-11-24 00:52:26,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43477 2837s 2024-11-24 00:52:26,457 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:26,457 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:26,457 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:26,457 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3r5u6s5q 2837s 2024-11-24 00:52:26,457 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:26,459 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35929. Reason: failure-to-start- 2837s 2024-11-24 00:52:26,459 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:26,459 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34279. Reason: failure-to-start- 2837s 2024-11-24 00:52:26,459 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:26,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43477': TLS handshake failed with remote 'tls://127.0.0.1:36982': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:26,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43477': TLS handshake failed with remote 'tls://127.0.0.1:36998': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:26,461 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:27,466 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:27,470 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33781 2837s 2024-11-24 00:52:27,470 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34155/status 2837s 2024-11-24 00:52:27,470 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:27,480 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38049 2837s 2024-11-24 00:52:27,480 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38049 2837s 2024-11-24 00:52:27,480 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:27,480 - distributed.worker - INFO - dashboard at: 127.0.0.1:45387 2837s 2024-11-24 00:52:27,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33781 2837s 2024-11-24 00:52:27,480 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:27,481 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:27,481 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:27,481 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7utlzj7p 2837s 2024-11-24 00:52:27,481 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:27,482 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44079 2837s 2024-11-24 00:52:27,482 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44079 2837s 2024-11-24 00:52:27,482 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:27,482 - distributed.worker - INFO - dashboard at: 127.0.0.1:40181 2837s 2024-11-24 00:52:27,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33781 2837s 2024-11-24 00:52:27,482 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:27,482 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:27,482 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:27,483 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y60cimtw 2837s 2024-11-24 00:52:27,483 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:27,484 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38049. Reason: failure-to-start- 2837s 2024-11-24 00:52:27,484 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:27,485 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44079. Reason: failure-to-start- 2837s 2024-11-24 00:52:27,485 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:27,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33781': TLS handshake failed with remote 'tls://127.0.0.1:59858': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:27,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33781': TLS handshake failed with remote 'tls://127.0.0.1:59870': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:27,487 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:28,491 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:28,495 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33101 2837s 2024-11-24 00:52:28,495 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43691/status 2837s 2024-11-24 00:52:28,495 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:28,505 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40557 2837s 2024-11-24 00:52:28,505 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40557 2837s 2024-11-24 00:52:28,505 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:28,505 - distributed.worker - INFO - dashboard at: 127.0.0.1:45579 2837s 2024-11-24 00:52:28,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33101 2837s 2024-11-24 00:52:28,505 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:28,505 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:28,505 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:28,505 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ik269nj7 2837s 2024-11-24 00:52:28,505 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:28,507 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42913 2837s 2024-11-24 00:52:28,507 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42913 2837s 2024-11-24 00:52:28,507 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:28,507 - distributed.worker - INFO - dashboard at: 127.0.0.1:38043 2837s 2024-11-24 00:52:28,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33101 2837s 2024-11-24 00:52:28,507 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:28,507 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:28,507 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:28,507 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nobirdrt 2837s 2024-11-24 00:52:28,507 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:28,508 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40557. Reason: failure-to-start- 2837s 2024-11-24 00:52:28,508 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:28,509 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42913. Reason: failure-to-start- 2837s 2024-11-24 00:52:28,509 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:28,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33101': TLS handshake failed with remote 'tls://127.0.0.1:55724': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:28,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33101': TLS handshake failed with remote 'tls://127.0.0.1:55726': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:28,511 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:29,515 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:29,519 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39927 2837s 2024-11-24 00:52:29,519 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42499/status 2837s 2024-11-24 00:52:29,519 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:29,528 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44225 2837s 2024-11-24 00:52:29,528 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44225 2837s 2024-11-24 00:52:29,528 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:29,528 - distributed.worker - INFO - dashboard at: 127.0.0.1:36603 2837s 2024-11-24 00:52:29,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39927 2837s 2024-11-24 00:52:29,528 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:29,528 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:29,528 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:29,528 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jb8jbtdj 2837s 2024-11-24 00:52:29,528 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:29,530 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34045 2837s 2024-11-24 00:52:29,530 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34045 2837s 2024-11-24 00:52:29,530 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:29,530 - distributed.worker - INFO - dashboard at: 127.0.0.1:35287 2837s 2024-11-24 00:52:29,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39927 2837s 2024-11-24 00:52:29,530 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:29,530 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:29,530 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:29,530 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pvfqyv_1 2837s 2024-11-24 00:52:29,530 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:29,532 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44225. Reason: failure-to-start- 2837s 2024-11-24 00:52:29,533 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:29,533 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34045. Reason: failure-to-start- 2837s 2024-11-24 00:52:29,533 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:29,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39927': TLS handshake failed with remote 'tls://127.0.0.1:52348': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:29,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39927': TLS handshake failed with remote 'tls://127.0.0.1:52358': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:29,535 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:30,539 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:30,543 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37595 2837s 2024-11-24 00:52:30,543 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38387/status 2837s 2024-11-24 00:52:30,543 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:30,552 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34389 2837s 2024-11-24 00:52:30,552 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34389 2837s 2024-11-24 00:52:30,552 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:30,552 - distributed.worker - INFO - dashboard at: 127.0.0.1:36517 2837s 2024-11-24 00:52:30,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37595 2837s 2024-11-24 00:52:30,552 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:30,552 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:30,552 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:30,552 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9b4u95e6 2837s 2024-11-24 00:52:30,552 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:30,554 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41723 2837s 2024-11-24 00:52:30,554 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41723 2837s 2024-11-24 00:52:30,554 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:30,554 - distributed.worker - INFO - dashboard at: 127.0.0.1:34635 2837s 2024-11-24 00:52:30,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37595 2837s 2024-11-24 00:52:30,554 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:30,554 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:30,554 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:30,554 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ib_v2aw5 2837s 2024-11-24 00:52:30,554 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:30,555 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34389. Reason: failure-to-start- 2837s 2024-11-24 00:52:30,555 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:30,556 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41723. Reason: failure-to-start- 2837s 2024-11-24 00:52:30,556 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:30,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37595': TLS handshake failed with remote 'tls://127.0.0.1:37682': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:30,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37595': TLS handshake failed with remote 'tls://127.0.0.1:37688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:30,558 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:52:31,563 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:31,567 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39475 2837s 2024-11-24 00:52:31,567 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37843/status 2837s 2024-11-24 00:52:31,567 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:31,576 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42445 2837s 2024-11-24 00:52:31,576 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42445 2837s 2024-11-24 00:52:31,576 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:31,576 - distributed.worker - INFO - dashboard at: 127.0.0.1:46497 2837s 2024-11-24 00:52:31,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39475 2837s 2024-11-24 00:52:31,577 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:31,577 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:31,577 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:31,577 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-31zhngpd 2837s 2024-11-24 00:52:31,577 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:31,578 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37543 2837s 2024-11-24 00:52:31,578 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37543 2837s 2024-11-24 00:52:31,578 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:31,578 - distributed.worker - INFO - dashboard at: 127.0.0.1:45921 2837s 2024-11-24 00:52:31,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39475 2837s 2024-11-24 00:52:31,579 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:31,579 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:52:31,579 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:31,579 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e_j05ogj 2837s 2024-11-24 00:52:31,579 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:31,580 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42445. Reason: failure-to-start- 2837s 2024-11-24 00:52:31,580 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:31,580 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37543. Reason: failure-to-start- 2837s 2024-11-24 00:52:31,580 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:31,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39475': TLS handshake failed with remote 'tls://127.0.0.1:35958': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:31,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39475': TLS handshake failed with remote 'tls://127.0.0.1:35972': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:52:31,582 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s __________________________ test_worker_client_gather ___________________________ 2837s 2837s fut = , timeout = 0 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 2837s await self._register_with_scheduler() 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2837s comm = await wait_for( 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2837s return await fut 2837s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 2837s stream = await self.client.connect( 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s host = '127.0.0.1', port = 44957, af = 2837s ssl_options = 2837s max_buffer_size = 4151066624.0, source_ip = None, source_port = None 2837s timeout = None 2837s 2837s async def connect( 2837s self, 2837s host: str, 2837s port: int, 2837s af: socket.AddressFamily = socket.AF_UNSPEC, 2837s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 2837s max_buffer_size: Optional[int] = None, 2837s source_ip: Optional[str] = None, 2837s source_port: Optional[int] = None, 2837s timeout: Optional[Union[float, datetime.timedelta]] = None, 2837s ) -> IOStream: 2837s """Connect to the given host and port. 2837s 2837s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 2837s ``ssl_options`` is not None). 2837s 2837s Using the ``source_ip`` kwarg, one can specify the source 2837s IP address to use when establishing the connection. 2837s In case the user needs to resolve and 2837s use a specific interface, it has to be handled outside 2837s of Tornado as this depends very much on the platform. 2837s 2837s Raises `TimeoutError` if the input future does not complete before 2837s ``timeout``, which may be specified in any form allowed by 2837s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 2837s relative to `.IOLoop.time`) 2837s 2837s Similarly, when the user requires a certain source port, it can 2837s be specified using the ``source_port`` arg. 2837s 2837s .. versionchanged:: 4.5 2837s Added the ``source_ip`` and ``source_port`` arguments. 2837s 2837s .. versionchanged:: 5.0 2837s Added the ``timeout`` argument. 2837s """ 2837s if timeout is not None: 2837s if isinstance(timeout, numbers.Real): 2837s timeout = IOLoop.current().time() + timeout 2837s elif isinstance(timeout, datetime.timedelta): 2837s timeout = IOLoop.current().time() + timeout.total_seconds() 2837s else: 2837s raise TypeError("Unsupported timeout %r" % timeout) 2837s if timeout is not None: 2837s addrinfo = await gen.with_timeout( 2837s timeout, self.resolver.resolve(host, port, af) 2837s ) 2837s else: 2837s addrinfo = await self.resolver.resolve(host, port, af) 2837s connector = _Connector( 2837s addrinfo, 2837s functools.partial( 2837s self._create_stream, 2837s max_buffer_size, 2837s source_ip=source_ip, 2837s source_port=source_port, 2837s ), 2837s ) 2837s > af, addr, stream = await connector.start(connect_timeout=timeout) 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s > await wait_for(self.start_unsafe(), timeout=timeout) 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:664: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s @contextlib.asynccontextmanager 2837s async def _cluster_factory(): 2837s workers = [] 2837s s = None 2837s try: 2837s for _ in range(60): 2837s try: 2837s > s, ws = await start_cluster( 2837s nthreads, 2837s scheduler, 2837s security=security, 2837s Worker=Worker, 2837s scheduler_kwargs=scheduler_kwargs, 2837s worker_kwargs=merge( 2837s {"death_timeout": min(15, int(deadline.remaining))}, 2837s worker_kwargs, 2837s ), 2837s ) 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 2837s await asyncio.gather(*workers) 2837s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 2837s return await awaitable 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s except asyncio.TimeoutError as exc: 2837s await _close_on_failure(exc) 2837s > raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s E TimeoutError: Worker start timed out after 0s. 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s fut = ._..test_func..async_fn at 0xe63f7717a650> 2837s timeout = 60 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 2837s _cluster_factory() as (s, workers), 2837s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 2837s return await anext(self.gen) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 2837s await asyncio.sleep(1) 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s delay = 1, result = None 2837s 2837s async def sleep(delay, result=None): 2837s """Coroutine that completes after a given time (in seconds).""" 2837s if delay <= 0: 2837s await __sleep0() 2837s return result 2837s 2837s if math.isnan(delay): 2837s raise ValueError("Invalid delay: NaN (not a number)") 2837s 2837s loop = events.get_running_loop() 2837s future = loop.create_future() 2837s h = loop.call_later(delay, 2837s futures._set_result_unless_cancelled, 2837s future, result) 2837s try: 2837s > return await future 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s args = (), kwds = {} 2837s 2837s @wraps(func) 2837s def inner(*args, **kwds): 2837s with self._recreate_cm(): 2837s > return func(*args, **kwds) 2837s 2837s /usr/lib/python3.13/contextlib.py:85: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3.13/contextlib.py:85: in inner 2837s return func(*args, **kwds) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 2837s return _run_and_close_tornado(async_fn_outer) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 2837s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 2837s /usr/lib/python3.13/asyncio/runners.py:194: in run 2837s return runner.run(main) 2837s /usr/lib/python3.13/asyncio/runners.py:118: in run 2837s return self._loop.run_until_complete(task) 2837s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 2837s return future.result() 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 2837s return await async_fn(*args, **kwargs) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 2837s return await utils_wait_for(async_fn(), timeout=timeout * 2) 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s ----------------------------- Captured stderr call ----------------------------- 2837s 2024-11-24 00:52:32,333 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:32,337 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:32,337 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39879/status 2837s 2024-11-24 00:52:32,337 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:32,345 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33181 2837s 2024-11-24 00:52:32,345 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33181 2837s 2024-11-24 00:52:32,345 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:32,345 - distributed.worker - INFO - dashboard at: 127.0.0.1:40439 2837s 2024-11-24 00:52:32,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:32,346 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:32,346 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:32,346 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:32,346 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5ncgo18g 2837s 2024-11-24 00:52:32,346 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:32,347 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43455 2837s 2024-11-24 00:52:32,347 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43455 2837s 2024-11-24 00:52:32,347 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:32,347 - distributed.worker - INFO - dashboard at: 127.0.0.1:40653 2837s 2024-11-24 00:52:32,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:32,347 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:32,347 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:32,347 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:32,348 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e7__c1zo 2837s 2024-11-24 00:52:32,348 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:32,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:32,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:32,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:32,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:32,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:32,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:32,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:32,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:32,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:32,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:32,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:32,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:32,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:32,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:32,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:32,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:32,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:32,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:32,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:32,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:32,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:32,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:32,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:32,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:33,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:33,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:34,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:34,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:39476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:35,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:35,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:36,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:36,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:37,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:37,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:38,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:38,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:39,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:39,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:45996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:40,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:40,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:41,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:41,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:42,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:42,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:43,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:43,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:44,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:44,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:46858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:40936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:40948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:40958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:40968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:40984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:40998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:45,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:45,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:46,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:46,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:47,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:47,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:47,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:47,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:47,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:47,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:47,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:47,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:47,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:47,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44859 2837s 2024-11-24 00:52:47,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:47,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44859': TLS handshake failed with remote 'tls://127.0.0.1:41294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:47,345 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33181. Reason: failure-to-start- 2837s 2024-11-24 00:52:47,345 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:47,346 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 15s. 2837s 2024-11-24 00:52:47,349 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43455. Reason: failure-to-start- 2837s 2024-11-24 00:52:47,350 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:52:48,352 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:52:48,356 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:48,356 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36129/status 2837s 2024-11-24 00:52:48,356 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:52:48,364 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42553 2837s 2024-11-24 00:52:48,365 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42553 2837s 2024-11-24 00:52:48,365 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:52:48,365 - distributed.worker - INFO - dashboard at: 127.0.0.1:35055 2837s 2024-11-24 00:52:48,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:48,365 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:48,365 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:48,365 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:48,365 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-138mg_b7 2837s 2024-11-24 00:52:48,365 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:48,366 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36083 2837s 2024-11-24 00:52:48,366 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36083 2837s 2024-11-24 00:52:48,366 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:52:48,366 - distributed.worker - INFO - dashboard at: 127.0.0.1:45039 2837s 2024-11-24 00:52:48,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:48,366 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:48,366 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:52:48,366 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:52:48,367 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hn36fqix 2837s 2024-11-24 00:52:48,367 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:52:48,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:48,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:48,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:48,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:48,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:48,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:48,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:48,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:48,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:48,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:48,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:48,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:48,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:48,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:48,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:48,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:48,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:48,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:48,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:48,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:48,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:48,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:48,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:48,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:49,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:49,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:50,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:50,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:33998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:51,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:51,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:52,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:52,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:53,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:53,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:54,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:54,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:34732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:39904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:39906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:39914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:39930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:39940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:39956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:39972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:39986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:39998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:55,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:55,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:56,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:56,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:57,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:57,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:58,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:58,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:52:59,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:52:59,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:00,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:00,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:01,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:01,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:01,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:01,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:01,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:01,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:01,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:01,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:01,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:01,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:01,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46593 2837s 2024-11-24 00:53:01,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46593': TLS handshake failed with remote 'tls://127.0.0.1:40938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:01,364 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42553. Reason: failure-to-start- 2837s 2024-11-24 00:53:01,364 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:01,366 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36083. Reason: failure-to-start- 2837s 2024-11-24 00:53:01,366 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:01,366 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 13s. 2837s 2024-11-24 00:53:02,372 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:02,375 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37323 2837s 2024-11-24 00:53:02,376 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42215/status 2837s 2024-11-24 00:53:02,376 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:02,384 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45735 2837s 2024-11-24 00:53:02,384 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45735 2837s 2024-11-24 00:53:02,384 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:02,384 - distributed.worker - INFO - dashboard at: 127.0.0.1:33237 2837s 2024-11-24 00:53:02,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37323 2837s 2024-11-24 00:53:02,384 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:02,384 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:02,385 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:02,385 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nr_zrdik 2837s 2024-11-24 00:53:02,385 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:02,386 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38255 2837s 2024-11-24 00:53:02,386 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38255 2837s 2024-11-24 00:53:02,386 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:02,386 - distributed.worker - INFO - dashboard at: 127.0.0.1:39367 2837s 2024-11-24 00:53:02,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37323 2837s 2024-11-24 00:53:02,386 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:02,386 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:02,387 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:02,387 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y6jl006x 2837s 2024-11-24 00:53:02,387 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:02,387 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45735. Reason: failure-to-start- 2837s 2024-11-24 00:53:02,387 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:02,388 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38255. Reason: failure-to-start- 2837s 2024-11-24 00:53:02,388 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:02,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37323': TLS handshake failed with remote 'tls://127.0.0.1:56466': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:02,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37323': TLS handshake failed with remote 'tls://127.0.0.1:56480': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:02,390 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:03,395 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:03,399 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45025 2837s 2024-11-24 00:53:03,400 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46197/status 2837s 2024-11-24 00:53:03,400 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:03,407 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34185 2837s 2024-11-24 00:53:03,407 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34185 2837s 2024-11-24 00:53:03,407 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:03,407 - distributed.worker - INFO - dashboard at: 127.0.0.1:37131 2837s 2024-11-24 00:53:03,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45025 2837s 2024-11-24 00:53:03,407 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:03,407 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:03,407 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:03,407 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aw3i2wqw 2837s 2024-11-24 00:53:03,407 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:03,409 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37745 2837s 2024-11-24 00:53:03,409 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37745 2837s 2024-11-24 00:53:03,409 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:03,409 - distributed.worker - INFO - dashboard at: 127.0.0.1:37087 2837s 2024-11-24 00:53:03,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45025 2837s 2024-11-24 00:53:03,409 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:03,409 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:03,409 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:03,409 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c9mq79tf 2837s 2024-11-24 00:53:03,409 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:03,410 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34185. Reason: failure-to-start- 2837s 2024-11-24 00:53:03,410 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:03,410 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37745. Reason: failure-to-start- 2837s 2024-11-24 00:53:03,410 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:03,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45025': TLS handshake failed with remote 'tls://127.0.0.1:54208': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:03,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45025': TLS handshake failed with remote 'tls://127.0.0.1:54210': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:03,412 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:04,417 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:04,421 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33219 2837s 2024-11-24 00:53:04,421 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39333/status 2837s 2024-11-24 00:53:04,421 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:04,430 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42245 2837s 2024-11-24 00:53:04,430 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42245 2837s 2024-11-24 00:53:04,430 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:04,430 - distributed.worker - INFO - dashboard at: 127.0.0.1:37783 2837s 2024-11-24 00:53:04,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33219 2837s 2024-11-24 00:53:04,430 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:04,430 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:04,430 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:04,430 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-83qcj4_w 2837s 2024-11-24 00:53:04,430 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:04,432 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37691 2837s 2024-11-24 00:53:04,432 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37691 2837s 2024-11-24 00:53:04,432 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:04,432 - distributed.worker - INFO - dashboard at: 127.0.0.1:43219 2837s 2024-11-24 00:53:04,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33219 2837s 2024-11-24 00:53:04,432 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:04,432 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:04,432 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:04,432 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rkl2ujoy 2837s 2024-11-24 00:53:04,432 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:04,433 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42245. Reason: failure-to-start- 2837s 2024-11-24 00:53:04,433 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:04,433 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37691. Reason: failure-to-start- 2837s 2024-11-24 00:53:04,433 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:04,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33219': TLS handshake failed with remote 'tls://127.0.0.1:53192': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:04,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33219': TLS handshake failed with remote 'tls://127.0.0.1:53204': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:04,435 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:05,439 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:05,443 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42459 2837s 2024-11-24 00:53:05,443 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43037/status 2837s 2024-11-24 00:53:05,443 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:05,451 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46827 2837s 2024-11-24 00:53:05,451 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46827 2837s 2024-11-24 00:53:05,451 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:05,451 - distributed.worker - INFO - dashboard at: 127.0.0.1:39883 2837s 2024-11-24 00:53:05,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42459 2837s 2024-11-24 00:53:05,451 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:05,451 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:05,451 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:05,451 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-en832mga 2837s 2024-11-24 00:53:05,451 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:05,453 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34721 2837s 2024-11-24 00:53:05,454 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34721 2837s 2024-11-24 00:53:05,454 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:05,454 - distributed.worker - INFO - dashboard at: 127.0.0.1:40103 2837s 2024-11-24 00:53:05,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42459 2837s 2024-11-24 00:53:05,454 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:05,454 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:05,454 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:05,454 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k9f8hg4s 2837s 2024-11-24 00:53:05,454 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:05,455 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46827. Reason: failure-to-start- 2837s 2024-11-24 00:53:05,455 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:05,455 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34721. Reason: failure-to-start- 2837s 2024-11-24 00:53:05,455 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:05,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42459': TLS handshake failed with remote 'tls://127.0.0.1:55530': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:05,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42459': TLS handshake failed with remote 'tls://127.0.0.1:55536': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:05,457 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:06,461 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:06,465 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40161 2837s 2024-11-24 00:53:06,465 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34581/status 2837s 2024-11-24 00:53:06,465 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:06,472 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36159 2837s 2024-11-24 00:53:06,472 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36159 2837s 2024-11-24 00:53:06,472 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:06,473 - distributed.worker - INFO - dashboard at: 127.0.0.1:42041 2837s 2024-11-24 00:53:06,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40161 2837s 2024-11-24 00:53:06,473 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:06,473 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:06,473 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:06,473 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ikjrzkq8 2837s 2024-11-24 00:53:06,473 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:06,474 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45395 2837s 2024-11-24 00:53:06,474 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45395 2837s 2024-11-24 00:53:06,474 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:06,474 - distributed.worker - INFO - dashboard at: 127.0.0.1:42175 2837s 2024-11-24 00:53:06,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40161 2837s 2024-11-24 00:53:06,474 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:06,474 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:06,474 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:06,474 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-80q8dlj8 2837s 2024-11-24 00:53:06,474 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:06,475 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36159. Reason: failure-to-start- 2837s 2024-11-24 00:53:06,475 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:06,476 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45395. Reason: failure-to-start- 2837s 2024-11-24 00:53:06,476 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:06,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40161': TLS handshake failed with remote 'tls://127.0.0.1:38916': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:06,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40161': TLS handshake failed with remote 'tls://127.0.0.1:38918': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:06,477 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:07,482 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:07,487 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46815 2837s 2024-11-24 00:53:07,487 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36363/status 2837s 2024-11-24 00:53:07,487 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:07,495 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34585 2837s 2024-11-24 00:53:07,495 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34585 2837s 2024-11-24 00:53:07,495 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:07,495 - distributed.worker - INFO - dashboard at: 127.0.0.1:42723 2837s 2024-11-24 00:53:07,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46815 2837s 2024-11-24 00:53:07,495 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:07,495 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:07,496 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:07,496 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zwlieiws 2837s 2024-11-24 00:53:07,496 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:07,497 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45241 2837s 2024-11-24 00:53:07,497 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45241 2837s 2024-11-24 00:53:07,497 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:07,497 - distributed.worker - INFO - dashboard at: 127.0.0.1:39889 2837s 2024-11-24 00:53:07,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46815 2837s 2024-11-24 00:53:07,497 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:07,497 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:07,497 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:07,497 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ohbsml_x 2837s 2024-11-24 00:53:07,498 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:07,498 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34585. Reason: failure-to-start- 2837s 2024-11-24 00:53:07,498 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:07,499 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45241. Reason: failure-to-start- 2837s 2024-11-24 00:53:07,499 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:07,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46815': TLS handshake failed with remote 'tls://127.0.0.1:52946': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:07,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46815': TLS handshake failed with remote 'tls://127.0.0.1:52956': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:07,501 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:08,505 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:08,509 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44907 2837s 2024-11-24 00:53:08,509 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35407/status 2837s 2024-11-24 00:53:08,509 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:08,518 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33877 2837s 2024-11-24 00:53:08,518 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33877 2837s 2024-11-24 00:53:08,518 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:08,518 - distributed.worker - INFO - dashboard at: 127.0.0.1:43521 2837s 2024-11-24 00:53:08,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44907 2837s 2024-11-24 00:53:08,518 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:08,518 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:08,518 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:08,518 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lfu__yeb 2837s 2024-11-24 00:53:08,519 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:08,520 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43473 2837s 2024-11-24 00:53:08,520 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43473 2837s 2024-11-24 00:53:08,520 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:08,520 - distributed.worker - INFO - dashboard at: 127.0.0.1:41291 2837s 2024-11-24 00:53:08,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44907 2837s 2024-11-24 00:53:08,520 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:08,520 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:08,520 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:08,520 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bvhjh1z4 2837s 2024-11-24 00:53:08,520 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:08,521 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33877. Reason: failure-to-start- 2837s 2024-11-24 00:53:08,521 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:08,521 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43473. Reason: failure-to-start- 2837s 2024-11-24 00:53:08,522 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:08,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44907': TLS handshake failed with remote 'tls://127.0.0.1:38966': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:08,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44907': TLS handshake failed with remote 'tls://127.0.0.1:38972': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:08,523 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:09,528 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:09,532 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40893 2837s 2024-11-24 00:53:09,532 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46681/status 2837s 2024-11-24 00:53:09,532 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:09,541 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37625 2837s 2024-11-24 00:53:09,541 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37625 2837s 2024-11-24 00:53:09,541 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:09,541 - distributed.worker - INFO - dashboard at: 127.0.0.1:41475 2837s 2024-11-24 00:53:09,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40893 2837s 2024-11-24 00:53:09,541 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:09,541 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:09,541 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:09,541 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tswk0z9p 2837s 2024-11-24 00:53:09,541 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:09,544 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39947 2837s 2024-11-24 00:53:09,544 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39947 2837s 2024-11-24 00:53:09,544 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:09,544 - distributed.worker - INFO - dashboard at: 127.0.0.1:45741 2837s 2024-11-24 00:53:09,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40893 2837s 2024-11-24 00:53:09,544 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:09,544 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:09,544 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:09,544 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0ykkrkb3 2837s 2024-11-24 00:53:09,544 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:09,545 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37625. Reason: failure-to-start- 2837s 2024-11-24 00:53:09,545 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:09,546 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39947. Reason: failure-to-start- 2837s 2024-11-24 00:53:09,546 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:09,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40893': TLS handshake failed with remote 'tls://127.0.0.1:37314': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:09,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40893': TLS handshake failed with remote 'tls://127.0.0.1:37320': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:09,548 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:10,552 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:10,556 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41965 2837s 2024-11-24 00:53:10,556 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45649/status 2837s 2024-11-24 00:53:10,556 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:10,564 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43407 2837s 2024-11-24 00:53:10,564 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43407 2837s 2024-11-24 00:53:10,564 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:10,564 - distributed.worker - INFO - dashboard at: 127.0.0.1:44381 2837s 2024-11-24 00:53:10,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41965 2837s 2024-11-24 00:53:10,564 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:10,564 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:10,564 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:10,565 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-35_qaipp 2837s 2024-11-24 00:53:10,565 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:10,566 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33917 2837s 2024-11-24 00:53:10,566 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33917 2837s 2024-11-24 00:53:10,566 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:10,566 - distributed.worker - INFO - dashboard at: 127.0.0.1:46863 2837s 2024-11-24 00:53:10,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41965 2837s 2024-11-24 00:53:10,566 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:10,566 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:10,566 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:10,566 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y9veaqry 2837s 2024-11-24 00:53:10,567 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:10,567 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43407. Reason: failure-to-start- 2837s 2024-11-24 00:53:10,567 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:10,568 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33917. Reason: failure-to-start- 2837s 2024-11-24 00:53:10,568 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:10,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41965': TLS handshake failed with remote 'tls://127.0.0.1:53656': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:10,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41965': TLS handshake failed with remote 'tls://127.0.0.1:53670': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:10,570 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:11,575 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:11,579 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45999 2837s 2024-11-24 00:53:11,579 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40921/status 2837s 2024-11-24 00:53:11,579 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:11,587 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36585 2837s 2024-11-24 00:53:11,587 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36585 2837s 2024-11-24 00:53:11,587 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:11,587 - distributed.worker - INFO - dashboard at: 127.0.0.1:33703 2837s 2024-11-24 00:53:11,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45999 2837s 2024-11-24 00:53:11,587 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:11,588 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:11,588 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:11,588 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-88i4caos 2837s 2024-11-24 00:53:11,588 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:11,589 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41299 2837s 2024-11-24 00:53:11,589 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41299 2837s 2024-11-24 00:53:11,589 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:11,589 - distributed.worker - INFO - dashboard at: 127.0.0.1:45433 2837s 2024-11-24 00:53:11,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45999 2837s 2024-11-24 00:53:11,589 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:11,589 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:11,589 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:11,589 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jbzj9hp2 2837s 2024-11-24 00:53:11,590 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:11,590 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36585. Reason: failure-to-start- 2837s 2024-11-24 00:53:11,590 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:11,591 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41299. Reason: failure-to-start- 2837s 2024-11-24 00:53:11,591 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:11,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45999': TLS handshake failed with remote 'tls://127.0.0.1:41378': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:11,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45999': TLS handshake failed with remote 'tls://127.0.0.1:41386': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:11,593 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:12,597 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:12,600 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34005 2837s 2024-11-24 00:53:12,601 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44535/status 2837s 2024-11-24 00:53:12,601 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:12,609 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35437 2837s 2024-11-24 00:53:12,609 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35437 2837s 2024-11-24 00:53:12,610 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:12,610 - distributed.worker - INFO - dashboard at: 127.0.0.1:46711 2837s 2024-11-24 00:53:12,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34005 2837s 2024-11-24 00:53:12,610 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:12,610 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:12,610 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:12,610 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1ythfz0g 2837s 2024-11-24 00:53:12,610 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:12,611 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38451 2837s 2024-11-24 00:53:12,611 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38451 2837s 2024-11-24 00:53:12,611 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:12,611 - distributed.worker - INFO - dashboard at: 127.0.0.1:35893 2837s 2024-11-24 00:53:12,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34005 2837s 2024-11-24 00:53:12,611 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:12,611 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:12,611 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:12,611 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_xajvu1_ 2837s 2024-11-24 00:53:12,612 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:12,612 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35437. Reason: failure-to-start- 2837s 2024-11-24 00:53:12,612 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:12,613 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38451. Reason: failure-to-start- 2837s 2024-11-24 00:53:12,613 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:12,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34005': TLS handshake failed with remote 'tls://127.0.0.1:48550': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:12,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34005': TLS handshake failed with remote 'tls://127.0.0.1:48566': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:12,615 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:13,619 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:13,623 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36341 2837s 2024-11-24 00:53:13,623 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40135/status 2837s 2024-11-24 00:53:13,624 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:13,632 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36861 2837s 2024-11-24 00:53:13,632 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36861 2837s 2024-11-24 00:53:13,632 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:13,632 - distributed.worker - INFO - dashboard at: 127.0.0.1:40947 2837s 2024-11-24 00:53:13,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36341 2837s 2024-11-24 00:53:13,632 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:13,632 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:13,632 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:13,632 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xe2h2bnf 2837s 2024-11-24 00:53:13,632 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:13,634 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43239 2837s 2024-11-24 00:53:13,635 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43239 2837s 2024-11-24 00:53:13,635 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:13,635 - distributed.worker - INFO - dashboard at: 127.0.0.1:41869 2837s 2024-11-24 00:53:13,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36341 2837s 2024-11-24 00:53:13,635 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:13,635 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:13,635 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:13,635 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i6zcgtko 2837s 2024-11-24 00:53:13,635 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:13,636 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36861. Reason: failure-to-start- 2837s 2024-11-24 00:53:13,636 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:13,636 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43239. Reason: failure-to-start- 2837s 2024-11-24 00:53:13,636 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:13,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36341': TLS handshake failed with remote 'tls://127.0.0.1:54872': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:13,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36341': TLS handshake failed with remote 'tls://127.0.0.1:54886': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:13,638 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:14,642 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:14,646 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39743 2837s 2024-11-24 00:53:14,646 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46705/status 2837s 2024-11-24 00:53:14,646 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:14,654 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32811 2837s 2024-11-24 00:53:14,654 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32811 2837s 2024-11-24 00:53:14,654 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:14,654 - distributed.worker - INFO - dashboard at: 127.0.0.1:45297 2837s 2024-11-24 00:53:14,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39743 2837s 2024-11-24 00:53:14,654 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:14,654 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:14,654 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:14,654 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tipl0__k 2837s 2024-11-24 00:53:14,654 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:14,656 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38621 2837s 2024-11-24 00:53:14,656 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38621 2837s 2024-11-24 00:53:14,656 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:14,656 - distributed.worker - INFO - dashboard at: 127.0.0.1:42577 2837s 2024-11-24 00:53:14,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39743 2837s 2024-11-24 00:53:14,656 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:14,656 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:14,656 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:14,656 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gqtyb2eq 2837s 2024-11-24 00:53:14,656 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:14,657 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32811. Reason: failure-to-start- 2837s 2024-11-24 00:53:14,657 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:14,657 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38621. Reason: failure-to-start- 2837s 2024-11-24 00:53:14,657 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:14,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39743': TLS handshake failed with remote 'tls://127.0.0.1:59502': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:14,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39743': TLS handshake failed with remote 'tls://127.0.0.1:59510': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:14,659 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:15,664 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:15,668 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42271 2837s 2024-11-24 00:53:15,668 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41269/status 2837s 2024-11-24 00:53:15,669 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:15,676 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35797 2837s 2024-11-24 00:53:15,676 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35797 2837s 2024-11-24 00:53:15,676 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:15,676 - distributed.worker - INFO - dashboard at: 127.0.0.1:46283 2837s 2024-11-24 00:53:15,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42271 2837s 2024-11-24 00:53:15,676 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:15,676 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:15,676 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:15,676 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yemfbzu_ 2837s 2024-11-24 00:53:15,676 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:15,677 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36475 2837s 2024-11-24 00:53:15,678 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36475 2837s 2024-11-24 00:53:15,678 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:15,678 - distributed.worker - INFO - dashboard at: 127.0.0.1:35967 2837s 2024-11-24 00:53:15,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42271 2837s 2024-11-24 00:53:15,678 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:15,678 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:15,678 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:15,678 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z8yz02__ 2837s 2024-11-24 00:53:15,678 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:15,679 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35797. Reason: failure-to-start- 2837s 2024-11-24 00:53:15,679 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:15,679 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36475. Reason: failure-to-start- 2837s 2024-11-24 00:53:15,679 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:15,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42271': TLS handshake failed with remote 'tls://127.0.0.1:59202': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:15,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42271': TLS handshake failed with remote 'tls://127.0.0.1:59206': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:15,681 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:16,685 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:16,688 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35663 2837s 2024-11-24 00:53:16,689 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34285/status 2837s 2024-11-24 00:53:16,689 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:16,698 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42409 2837s 2024-11-24 00:53:16,698 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42409 2837s 2024-11-24 00:53:16,698 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:16,698 - distributed.worker - INFO - dashboard at: 127.0.0.1:42261 2837s 2024-11-24 00:53:16,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35663 2837s 2024-11-24 00:53:16,698 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:16,698 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:16,698 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:16,698 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7va4egnq 2837s 2024-11-24 00:53:16,698 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:16,699 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45719 2837s 2024-11-24 00:53:16,699 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45719 2837s 2024-11-24 00:53:16,699 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:16,700 - distributed.worker - INFO - dashboard at: 127.0.0.1:33429 2837s 2024-11-24 00:53:16,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35663 2837s 2024-11-24 00:53:16,700 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:16,700 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:16,700 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:16,700 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f4bspepx 2837s 2024-11-24 00:53:16,700 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:16,701 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42409. Reason: failure-to-start- 2837s 2024-11-24 00:53:16,701 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:16,701 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45719. Reason: failure-to-start- 2837s 2024-11-24 00:53:16,701 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:16,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35663': TLS handshake failed with remote 'tls://127.0.0.1:35746': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:16,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35663': TLS handshake failed with remote 'tls://127.0.0.1:35758': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:16,703 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:17,708 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:17,712 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42479 2837s 2024-11-24 00:53:17,712 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45781/status 2837s 2024-11-24 00:53:17,712 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:17,729 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41377 2837s 2024-11-24 00:53:17,729 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41377 2837s 2024-11-24 00:53:17,729 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:17,729 - distributed.worker - INFO - dashboard at: 127.0.0.1:36559 2837s 2024-11-24 00:53:17,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42479 2837s 2024-11-24 00:53:17,729 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:17,730 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:17,730 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:17,730 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3rcvxwzy 2837s 2024-11-24 00:53:17,730 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:17,731 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37335 2837s 2024-11-24 00:53:17,731 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37335 2837s 2024-11-24 00:53:17,731 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:17,731 - distributed.worker - INFO - dashboard at: 127.0.0.1:46573 2837s 2024-11-24 00:53:17,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42479 2837s 2024-11-24 00:53:17,731 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:17,731 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:17,731 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:17,731 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-53sl6kc8 2837s 2024-11-24 00:53:17,731 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:17,732 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41377. Reason: failure-to-start- 2837s 2024-11-24 00:53:17,732 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:17,733 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37335. Reason: failure-to-start- 2837s 2024-11-24 00:53:17,733 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:17,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42479': TLS handshake failed with remote 'tls://127.0.0.1:44170': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:17,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42479': TLS handshake failed with remote 'tls://127.0.0.1:44172': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:17,735 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:18,740 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:18,743 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42935 2837s 2024-11-24 00:53:18,744 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46657/status 2837s 2024-11-24 00:53:18,744 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:18,752 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41789 2837s 2024-11-24 00:53:18,752 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41789 2837s 2024-11-24 00:53:18,752 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:18,752 - distributed.worker - INFO - dashboard at: 127.0.0.1:37667 2837s 2024-11-24 00:53:18,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42935 2837s 2024-11-24 00:53:18,753 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:18,753 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:18,753 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:18,753 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p_1bxc9_ 2837s 2024-11-24 00:53:18,753 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:18,754 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46417 2837s 2024-11-24 00:53:18,754 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46417 2837s 2024-11-24 00:53:18,754 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:18,754 - distributed.worker - INFO - dashboard at: 127.0.0.1:42059 2837s 2024-11-24 00:53:18,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42935 2837s 2024-11-24 00:53:18,754 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:18,755 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:18,755 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:18,755 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-on527lzi 2837s 2024-11-24 00:53:18,755 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:18,755 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41789. Reason: failure-to-start- 2837s 2024-11-24 00:53:18,756 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:18,756 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46417. Reason: failure-to-start- 2837s 2024-11-24 00:53:18,756 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:18,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42935': TLS handshake failed with remote 'tls://127.0.0.1:35032': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:18,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42935': TLS handshake failed with remote 'tls://127.0.0.1:35044': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:18,758 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:19,764 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:19,768 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37353 2837s 2024-11-24 00:53:19,768 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43635/status 2837s 2024-11-24 00:53:19,768 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:19,776 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44613 2837s 2024-11-24 00:53:19,776 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44613 2837s 2024-11-24 00:53:19,776 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:19,776 - distributed.worker - INFO - dashboard at: 127.0.0.1:37999 2837s 2024-11-24 00:53:19,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37353 2837s 2024-11-24 00:53:19,776 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:19,776 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:19,776 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:19,776 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gnsm1zl_ 2837s 2024-11-24 00:53:19,776 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:19,777 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46737 2837s 2024-11-24 00:53:19,777 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46737 2837s 2024-11-24 00:53:19,778 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:19,778 - distributed.worker - INFO - dashboard at: 127.0.0.1:46203 2837s 2024-11-24 00:53:19,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37353 2837s 2024-11-24 00:53:19,778 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:19,778 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:19,778 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:19,778 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1tofhtj4 2837s 2024-11-24 00:53:19,778 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:19,779 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44613. Reason: failure-to-start- 2837s 2024-11-24 00:53:19,779 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:19,779 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46737. Reason: failure-to-start- 2837s 2024-11-24 00:53:19,779 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:19,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37353': TLS handshake failed with remote 'tls://127.0.0.1:40604': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:19,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37353': TLS handshake failed with remote 'tls://127.0.0.1:40614': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:19,781 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:20,785 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:20,788 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44363 2837s 2024-11-24 00:53:20,789 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44245/status 2837s 2024-11-24 00:53:20,789 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:20,798 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36203 2837s 2024-11-24 00:53:20,798 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36203 2837s 2024-11-24 00:53:20,798 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:20,798 - distributed.worker - INFO - dashboard at: 127.0.0.1:40753 2837s 2024-11-24 00:53:20,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44363 2837s 2024-11-24 00:53:20,798 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:20,798 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:20,798 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:20,798 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sb3d30p0 2837s 2024-11-24 00:53:20,798 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:20,799 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40907 2837s 2024-11-24 00:53:20,800 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40907 2837s 2024-11-24 00:53:20,800 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:20,800 - distributed.worker - INFO - dashboard at: 127.0.0.1:33695 2837s 2024-11-24 00:53:20,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44363 2837s 2024-11-24 00:53:20,800 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:20,800 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:20,800 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:20,800 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v214p6f9 2837s 2024-11-24 00:53:20,800 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:20,801 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36203. Reason: failure-to-start- 2837s 2024-11-24 00:53:20,801 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:20,801 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40907. Reason: failure-to-start- 2837s 2024-11-24 00:53:20,801 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:20,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44363': TLS handshake failed with remote 'tls://127.0.0.1:59676': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:20,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44363': TLS handshake failed with remote 'tls://127.0.0.1:59688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:20,803 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:21,807 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:21,811 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45405 2837s 2024-11-24 00:53:21,811 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34939/status 2837s 2024-11-24 00:53:21,811 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:21,819 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44289 2837s 2024-11-24 00:53:21,819 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44289 2837s 2024-11-24 00:53:21,819 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:21,819 - distributed.worker - INFO - dashboard at: 127.0.0.1:33877 2837s 2024-11-24 00:53:21,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45405 2837s 2024-11-24 00:53:21,819 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:21,819 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:21,819 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:21,819 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s6r_p4ru 2837s 2024-11-24 00:53:21,819 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:21,821 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41121 2837s 2024-11-24 00:53:21,822 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41121 2837s 2024-11-24 00:53:21,822 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:21,822 - distributed.worker - INFO - dashboard at: 127.0.0.1:41359 2837s 2024-11-24 00:53:21,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45405 2837s 2024-11-24 00:53:21,822 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:21,822 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:21,822 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:21,822 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3yzv1qlh 2837s 2024-11-24 00:53:21,822 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:21,823 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44289. Reason: failure-to-start- 2837s 2024-11-24 00:53:21,823 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:21,823 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41121. Reason: failure-to-start- 2837s 2024-11-24 00:53:21,823 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:21,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45405': TLS handshake failed with remote 'tls://127.0.0.1:37232': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:21,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45405': TLS handshake failed with remote 'tls://127.0.0.1:37248': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:21,825 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:22,830 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:22,834 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43871 2837s 2024-11-24 00:53:22,834 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32889/status 2837s 2024-11-24 00:53:22,834 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:22,842 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41735 2837s 2024-11-24 00:53:22,842 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41735 2837s 2024-11-24 00:53:22,842 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:22,842 - distributed.worker - INFO - dashboard at: 127.0.0.1:41009 2837s 2024-11-24 00:53:22,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43871 2837s 2024-11-24 00:53:22,842 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:22,842 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:22,843 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:22,843 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-77igpdvc 2837s 2024-11-24 00:53:22,843 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:22,844 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43541 2837s 2024-11-24 00:53:22,844 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43541 2837s 2024-11-24 00:53:22,844 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:22,844 - distributed.worker - INFO - dashboard at: 127.0.0.1:38385 2837s 2024-11-24 00:53:22,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43871 2837s 2024-11-24 00:53:22,844 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:22,844 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:22,844 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:22,844 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vkbd17dn 2837s 2024-11-24 00:53:22,845 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:22,846 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41735. Reason: failure-to-start- 2837s 2024-11-24 00:53:22,846 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:22,847 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43541. Reason: failure-to-start- 2837s 2024-11-24 00:53:22,848 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:22,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43871': TLS handshake failed with remote 'tls://127.0.0.1:42808': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:22,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43871': TLS handshake failed with remote 'tls://127.0.0.1:42814': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:22,850 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:23,855 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:23,859 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42907 2837s 2024-11-24 00:53:23,859 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43695/status 2837s 2024-11-24 00:53:23,859 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:23,869 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46175 2837s 2024-11-24 00:53:23,869 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46175 2837s 2024-11-24 00:53:23,869 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:23,870 - distributed.worker - INFO - dashboard at: 127.0.0.1:35515 2837s 2024-11-24 00:53:23,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42907 2837s 2024-11-24 00:53:23,870 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:23,870 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:23,870 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:23,870 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-szz4twwy 2837s 2024-11-24 00:53:23,870 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:23,871 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37045 2837s 2024-11-24 00:53:23,871 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37045 2837s 2024-11-24 00:53:23,871 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:23,871 - distributed.worker - INFO - dashboard at: 127.0.0.1:45389 2837s 2024-11-24 00:53:23,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42907 2837s 2024-11-24 00:53:23,872 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:23,872 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:23,872 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:23,872 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wwmql200 2837s 2024-11-24 00:53:23,872 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:23,873 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46175. Reason: failure-to-start- 2837s 2024-11-24 00:53:23,873 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:23,873 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37045. Reason: failure-to-start- 2837s 2024-11-24 00:53:23,873 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:23,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42907': TLS handshake failed with remote 'tls://127.0.0.1:35518': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:23,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42907': TLS handshake failed with remote 'tls://127.0.0.1:35522': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:23,875 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:24,879 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:24,884 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36183 2837s 2024-11-24 00:53:24,884 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34931/status 2837s 2024-11-24 00:53:24,884 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:24,892 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37285 2837s 2024-11-24 00:53:24,892 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37285 2837s 2024-11-24 00:53:24,892 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:24,892 - distributed.worker - INFO - dashboard at: 127.0.0.1:42265 2837s 2024-11-24 00:53:24,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36183 2837s 2024-11-24 00:53:24,892 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:24,892 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:24,892 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:24,892 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nizt7r2i 2837s 2024-11-24 00:53:24,892 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:24,894 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37047 2837s 2024-11-24 00:53:24,894 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37047 2837s 2024-11-24 00:53:24,894 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:24,894 - distributed.worker - INFO - dashboard at: 127.0.0.1:35727 2837s 2024-11-24 00:53:24,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36183 2837s 2024-11-24 00:53:24,894 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:24,894 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:24,894 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:24,894 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vcqp_b2d 2837s 2024-11-24 00:53:24,894 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:24,895 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37285. Reason: failure-to-start- 2837s 2024-11-24 00:53:24,895 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:24,895 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37047. Reason: failure-to-start- 2837s 2024-11-24 00:53:24,895 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:24,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36183': TLS handshake failed with remote 'tls://127.0.0.1:39642': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:24,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36183': TLS handshake failed with remote 'tls://127.0.0.1:39656': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:24,897 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:25,902 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:25,905 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42417 2837s 2024-11-24 00:53:25,906 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34957/status 2837s 2024-11-24 00:53:25,906 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:25,916 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42493 2837s 2024-11-24 00:53:25,916 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42493 2837s 2024-11-24 00:53:25,916 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:25,916 - distributed.worker - INFO - dashboard at: 127.0.0.1:35831 2837s 2024-11-24 00:53:25,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42417 2837s 2024-11-24 00:53:25,916 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:25,916 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:25,916 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:25,916 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wbsqe40v 2837s 2024-11-24 00:53:25,916 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:25,918 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35359 2837s 2024-11-24 00:53:25,918 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35359 2837s 2024-11-24 00:53:25,918 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:25,918 - distributed.worker - INFO - dashboard at: 127.0.0.1:41503 2837s 2024-11-24 00:53:25,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42417 2837s 2024-11-24 00:53:25,918 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:25,918 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:25,918 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:25,918 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6r94msxc 2837s 2024-11-24 00:53:25,918 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:25,919 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42493. Reason: failure-to-start- 2837s 2024-11-24 00:53:25,919 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:25,919 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35359. Reason: failure-to-start- 2837s 2024-11-24 00:53:25,919 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:25,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42417': TLS handshake failed with remote 'tls://127.0.0.1:33838': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:25,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42417': TLS handshake failed with remote 'tls://127.0.0.1:33842': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:25,922 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:26,926 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:26,932 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41389 2837s 2024-11-24 00:53:26,932 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36961/status 2837s 2024-11-24 00:53:26,932 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:26,940 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35027 2837s 2024-11-24 00:53:26,940 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35027 2837s 2024-11-24 00:53:26,940 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:26,940 - distributed.worker - INFO - dashboard at: 127.0.0.1:35773 2837s 2024-11-24 00:53:26,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41389 2837s 2024-11-24 00:53:26,940 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:26,940 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:26,940 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:26,940 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v8t0wyeu 2837s 2024-11-24 00:53:26,940 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:26,943 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37755 2837s 2024-11-24 00:53:26,943 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37755 2837s 2024-11-24 00:53:26,943 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:26,943 - distributed.worker - INFO - dashboard at: 127.0.0.1:45403 2837s 2024-11-24 00:53:26,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41389 2837s 2024-11-24 00:53:26,943 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:26,943 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:26,943 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:26,943 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bppv09wk 2837s 2024-11-24 00:53:26,943 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:26,944 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35027. Reason: failure-to-start- 2837s 2024-11-24 00:53:26,944 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:26,945 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37755. Reason: failure-to-start- 2837s 2024-11-24 00:53:26,945 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:26,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41389': TLS handshake failed with remote 'tls://127.0.0.1:45576': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:26,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41389': TLS handshake failed with remote 'tls://127.0.0.1:45586': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:26,948 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:27,952 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:27,956 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38791 2837s 2024-11-24 00:53:27,956 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36093/status 2837s 2024-11-24 00:53:27,956 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:27,964 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45667 2837s 2024-11-24 00:53:27,964 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45667 2837s 2024-11-24 00:53:27,964 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:27,964 - distributed.worker - INFO - dashboard at: 127.0.0.1:45497 2837s 2024-11-24 00:53:27,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38791 2837s 2024-11-24 00:53:27,964 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:27,964 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:27,964 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:27,964 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_dc5j24w 2837s 2024-11-24 00:53:27,964 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:27,966 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42173 2837s 2024-11-24 00:53:27,966 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42173 2837s 2024-11-24 00:53:27,966 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:27,966 - distributed.worker - INFO - dashboard at: 127.0.0.1:35795 2837s 2024-11-24 00:53:27,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38791 2837s 2024-11-24 00:53:27,966 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:27,966 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:27,966 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:27,966 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-stpzgfm8 2837s 2024-11-24 00:53:27,966 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:27,967 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45667. Reason: failure-to-start- 2837s 2024-11-24 00:53:27,967 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:27,968 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42173. Reason: failure-to-start- 2837s 2024-11-24 00:53:27,968 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:27,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38791': TLS handshake failed with remote 'tls://127.0.0.1:52652': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:27,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38791': TLS handshake failed with remote 'tls://127.0.0.1:52656': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:27,971 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:28,975 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:28,979 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44583 2837s 2024-11-24 00:53:28,980 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32909/status 2837s 2024-11-24 00:53:28,980 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:28,988 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44267 2837s 2024-11-24 00:53:28,989 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44267 2837s 2024-11-24 00:53:28,989 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:28,989 - distributed.worker - INFO - dashboard at: 127.0.0.1:37099 2837s 2024-11-24 00:53:28,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44583 2837s 2024-11-24 00:53:28,989 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:28,989 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:28,989 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:28,989 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8jfz3es3 2837s 2024-11-24 00:53:28,989 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:28,990 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42435 2837s 2024-11-24 00:53:28,991 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42435 2837s 2024-11-24 00:53:28,991 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:28,991 - distributed.worker - INFO - dashboard at: 127.0.0.1:44729 2837s 2024-11-24 00:53:28,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44583 2837s 2024-11-24 00:53:28,991 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:28,991 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:28,991 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:28,991 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l936c3y3 2837s 2024-11-24 00:53:28,991 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:28,992 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44267. Reason: failure-to-start- 2837s 2024-11-24 00:53:28,992 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:28,992 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42435. Reason: failure-to-start- 2837s 2024-11-24 00:53:28,992 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:28,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44583': TLS handshake failed with remote 'tls://127.0.0.1:57660': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:28,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44583': TLS handshake failed with remote 'tls://127.0.0.1:57662': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:28,995 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:30,000 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:30,005 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33779 2837s 2024-11-24 00:53:30,006 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36571/status 2837s 2024-11-24 00:53:30,006 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:30,014 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46067 2837s 2024-11-24 00:53:30,014 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46067 2837s 2024-11-24 00:53:30,014 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:30,014 - distributed.worker - INFO - dashboard at: 127.0.0.1:32797 2837s 2024-11-24 00:53:30,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33779 2837s 2024-11-24 00:53:30,014 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:30,014 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:30,014 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:30,014 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x_yw_738 2837s 2024-11-24 00:53:30,014 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:30,015 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43963 2837s 2024-11-24 00:53:30,016 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43963 2837s 2024-11-24 00:53:30,016 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:30,016 - distributed.worker - INFO - dashboard at: 127.0.0.1:45347 2837s 2024-11-24 00:53:30,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33779 2837s 2024-11-24 00:53:30,016 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:30,016 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:30,016 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:30,016 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ipnpru2a 2837s 2024-11-24 00:53:30,016 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:30,018 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46067. Reason: failure-to-start- 2837s 2024-11-24 00:53:30,018 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:30,018 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43963. Reason: failure-to-start- 2837s 2024-11-24 00:53:30,018 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:30,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33779': TLS handshake failed with remote 'tls://127.0.0.1:43742': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:30,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33779': TLS handshake failed with remote 'tls://127.0.0.1:43754': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:30,020 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:31,025 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:31,028 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41469 2837s 2024-11-24 00:53:31,029 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42803/status 2837s 2024-11-24 00:53:31,029 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:31,039 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34583 2837s 2024-11-24 00:53:31,039 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34583 2837s 2024-11-24 00:53:31,039 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:31,039 - distributed.worker - INFO - dashboard at: 127.0.0.1:43925 2837s 2024-11-24 00:53:31,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41469 2837s 2024-11-24 00:53:31,039 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:31,039 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:31,040 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:31,040 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-221ra72a 2837s 2024-11-24 00:53:31,040 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:31,041 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43313 2837s 2024-11-24 00:53:31,041 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43313 2837s 2024-11-24 00:53:31,041 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:31,041 - distributed.worker - INFO - dashboard at: 127.0.0.1:45915 2837s 2024-11-24 00:53:31,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41469 2837s 2024-11-24 00:53:31,041 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:31,042 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:31,042 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:31,042 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1n2s271o 2837s 2024-11-24 00:53:31,042 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:31,043 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34583. Reason: failure-to-start- 2837s 2024-11-24 00:53:31,044 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:31,044 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43313. Reason: failure-to-start- 2837s 2024-11-24 00:53:31,044 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:31,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41469': TLS handshake failed with remote 'tls://127.0.0.1:44156': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:31,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41469': TLS handshake failed with remote 'tls://127.0.0.1:44170': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:31,046 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:53:32,051 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:32,054 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44957 2837s 2024-11-24 00:53:32,055 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43421/status 2837s 2024-11-24 00:53:32,055 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:32,063 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35805 2837s 2024-11-24 00:53:32,063 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35805 2837s 2024-11-24 00:53:32,063 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:32,063 - distributed.worker - INFO - dashboard at: 127.0.0.1:40879 2837s 2024-11-24 00:53:32,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44957 2837s 2024-11-24 00:53:32,063 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:32,063 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:32,063 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:32,063 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3b2ql_0a 2837s 2024-11-24 00:53:32,063 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:32,066 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37167 2837s 2024-11-24 00:53:32,066 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37167 2837s 2024-11-24 00:53:32,066 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:32,066 - distributed.worker - INFO - dashboard at: 127.0.0.1:33601 2837s 2024-11-24 00:53:32,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44957 2837s 2024-11-24 00:53:32,066 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:32,066 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:32,066 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:32,066 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bxbrlf10 2837s 2024-11-24 00:53:32,066 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:32,068 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35805. Reason: failure-to-start- 2837s 2024-11-24 00:53:32,068 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:32,068 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37167. Reason: failure-to-start- 2837s 2024-11-24 00:53:32,068 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:32,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44957': TLS handshake failed with remote 'tls://127.0.0.1:58638': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:32,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44957': TLS handshake failed with remote 'tls://127.0.0.1:58654': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:32,070 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s _________________________ test_worker_client_executor __________________________ 2837s 2837s fut = ._..test_func..async_fn at 0xe63f7717a820> 2837s timeout = 60 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 2837s _cluster_factory() as (s, workers), 2837s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 2837s return await anext(self.gen) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: in _cluster_factory 2837s s, ws = await start_cluster( 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 2837s await asyncio.gather(*workers) 2837s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 2837s return await awaitable 2837s /usr/lib/python3/dist-packages/distributed/core.py:664: in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2837s return await fut 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 2837s await self._register_with_scheduler() 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2837s comm = await wait_for( 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2837s return await fut 2837s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 2837s stream = await self.client.connect( 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s host = '127.0.0.1', port = 39173, af = 2837s ssl_options = 2837s max_buffer_size = 4151066624.0, source_ip = None, source_port = None 2837s timeout = None 2837s 2837s async def connect( 2837s self, 2837s host: str, 2837s port: int, 2837s af: socket.AddressFamily = socket.AF_UNSPEC, 2837s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 2837s max_buffer_size: Optional[int] = None, 2837s source_ip: Optional[str] = None, 2837s source_port: Optional[int] = None, 2837s timeout: Optional[Union[float, datetime.timedelta]] = None, 2837s ) -> IOStream: 2837s """Connect to the given host and port. 2837s 2837s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 2837s ``ssl_options`` is not None). 2837s 2837s Using the ``source_ip`` kwarg, one can specify the source 2837s IP address to use when establishing the connection. 2837s In case the user needs to resolve and 2837s use a specific interface, it has to be handled outside 2837s of Tornado as this depends very much on the platform. 2837s 2837s Raises `TimeoutError` if the input future does not complete before 2837s ``timeout``, which may be specified in any form allowed by 2837s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 2837s relative to `.IOLoop.time`) 2837s 2837s Similarly, when the user requires a certain source port, it can 2837s be specified using the ``source_port`` arg. 2837s 2837s .. versionchanged:: 4.5 2837s Added the ``source_ip`` and ``source_port`` arguments. 2837s 2837s .. versionchanged:: 5.0 2837s Added the ``timeout`` argument. 2837s """ 2837s if timeout is not None: 2837s if isinstance(timeout, numbers.Real): 2837s timeout = IOLoop.current().time() + timeout 2837s elif isinstance(timeout, datetime.timedelta): 2837s timeout = IOLoop.current().time() + timeout.total_seconds() 2837s else: 2837s raise TypeError("Unsupported timeout %r" % timeout) 2837s if timeout is not None: 2837s addrinfo = await gen.with_timeout( 2837s timeout, self.resolver.resolve(host, port, af) 2837s ) 2837s else: 2837s addrinfo = await self.resolver.resolve(host, port, af) 2837s connector = _Connector( 2837s addrinfo, 2837s functools.partial( 2837s self._create_stream, 2837s max_buffer_size, 2837s source_ip=source_ip, 2837s source_port=source_port, 2837s ), 2837s ) 2837s > af, addr, stream = await connector.start(connect_timeout=timeout) 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s args = (), kwds = {} 2837s 2837s @wraps(func) 2837s def inner(*args, **kwds): 2837s with self._recreate_cm(): 2837s > return func(*args, **kwds) 2837s 2837s /usr/lib/python3.13/contextlib.py:85: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3.13/contextlib.py:85: in inner 2837s return func(*args, **kwds) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 2837s return _run_and_close_tornado(async_fn_outer) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 2837s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 2837s /usr/lib/python3.13/asyncio/runners.py:194: in run 2837s return runner.run(main) 2837s /usr/lib/python3.13/asyncio/runners.py:118: in run 2837s return self._loop.run_until_complete(task) 2837s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 2837s return future.result() 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 2837s return await async_fn(*args, **kwargs) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 2837s return await utils_wait_for(async_fn(), timeout=timeout * 2) 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s ----------------------------- Captured stderr call ----------------------------- 2837s 2024-11-24 00:53:32,789 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:32,792 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:32,793 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38403/status 2837s 2024-11-24 00:53:32,793 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:32,800 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38049 2837s 2024-11-24 00:53:32,801 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38049 2837s 2024-11-24 00:53:32,801 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:32,801 - distributed.worker - INFO - dashboard at: 127.0.0.1:37609 2837s 2024-11-24 00:53:32,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:32,801 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:32,801 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:32,801 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:32,801 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rf5ldrm7 2837s 2024-11-24 00:53:32,801 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:32,802 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42631 2837s 2024-11-24 00:53:32,802 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42631 2837s 2024-11-24 00:53:32,802 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:32,802 - distributed.worker - INFO - dashboard at: 127.0.0.1:46169 2837s 2024-11-24 00:53:32,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:32,803 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:32,803 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:53:32,803 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:32,803 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yfgucwzo 2837s 2024-11-24 00:53:32,803 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:32,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:32,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:32,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:32,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:32,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:32,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:32,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:32,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:33,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:33,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:52990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:53004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:53008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:53020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:53032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:53048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:53054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:53058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:53070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:34,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:53086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:34,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:53100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:53106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:53112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:53124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:53140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:53148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:53152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:35,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:35,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:59988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:36,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:36,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:37,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:37,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:38,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:38,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:39,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:39,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:40,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:40,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:41,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:41,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:60998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:42,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:42,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:43,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:43,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:32998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:33006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:33014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:33018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:33026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:33040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:33048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:33054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:33056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:33066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:33074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:44,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:44,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:33090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:33102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:33112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:33126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:33136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:33144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:33150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:45,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:45,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:46,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:46,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:47,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:47,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:47,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:47,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:47,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:47,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:47,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:47,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:47,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:47,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:47,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:47,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:47,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:47,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:47,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:47,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:47,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:47,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:47,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:47,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:47,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:47,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:47,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:47,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:47,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:47,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:47,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45587 2837s 2024-11-24 00:53:47,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:47,800 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38049. Reason: failure-to-start- 2837s 2024-11-24 00:53:47,800 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:47,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:47,802 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42631. Reason: failure-to-start- 2837s 2024-11-24 00:53:47,802 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:53:47,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45587': TLS handshake failed with remote 'tls://127.0.0.1:34688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:53:47,803 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 15s. 2837s 2024-11-24 00:53:48,808 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:53:48,812 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:48,812 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45577/status 2837s 2024-11-24 00:53:48,812 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:53:48,821 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33533 2837s 2024-11-24 00:53:48,821 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33533 2837s 2024-11-24 00:53:48,821 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:53:48,822 - distributed.worker - INFO - dashboard at: 127.0.0.1:33535 2837s 2024-11-24 00:53:48,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:48,822 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:48,822 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:53:48,822 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:48,822 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qa32pp6p 2837s 2024-11-24 00:53:48,822 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:48,823 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44417 2837s 2024-11-24 00:53:48,823 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44417 2837s 2024-11-24 00:53:48,823 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:53:48,823 - distributed.worker - INFO - dashboard at: 127.0.0.1:40571 2837s 2024-11-24 00:53:48,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:48,824 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:48,824 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:53:48,824 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:53:48,824 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-to345dr6 2837s 2024-11-24 00:53:48,824 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:53:48,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:48,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:48,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:48,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:48,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:48,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:48,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:48,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:49,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:49,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:46996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:50,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:50,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:51,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:51,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:52,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:52,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:53,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:53,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:54,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:54,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:47654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:55,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:55,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:44994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:56,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:56,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:57,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:57,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:58,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:58,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:53:59,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:53:59,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:00,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:00,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:01,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:01,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:01,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:01,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:01,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:01,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:01,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:01,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:01,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:01,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:01,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:01,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:01,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:01,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:01,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:01,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:01,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:01,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:01,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:01,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:01,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:01,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:01,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:01,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:01,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:01,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40897 2837s 2024-11-24 00:54:01,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:01,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40897': TLS handshake failed with remote 'tls://127.0.0.1:45874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:01,821 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33533. Reason: failure-to-start- 2837s 2024-11-24 00:54:01,821 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:01,822 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 13s. 2837s 2024-11-24 00:54:01,825 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44417. Reason: failure-to-start- 2837s 2024-11-24 00:54:01,825 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:02,827 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:02,831 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35809 2837s 2024-11-24 00:54:02,831 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37021/status 2837s 2024-11-24 00:54:02,831 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:02,841 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37517 2837s 2024-11-24 00:54:02,841 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37517 2837s 2024-11-24 00:54:02,841 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:02,841 - distributed.worker - INFO - dashboard at: 127.0.0.1:44891 2837s 2024-11-24 00:54:02,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35809 2837s 2024-11-24 00:54:02,841 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:02,841 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:02,841 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:02,841 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v0cssbh_ 2837s 2024-11-24 00:54:02,841 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:02,842 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40281 2837s 2024-11-24 00:54:02,843 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40281 2837s 2024-11-24 00:54:02,843 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:02,843 - distributed.worker - INFO - dashboard at: 127.0.0.1:42447 2837s 2024-11-24 00:54:02,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35809 2837s 2024-11-24 00:54:02,843 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:02,843 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:02,843 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:02,843 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zwlw7v_5 2837s 2024-11-24 00:54:02,843 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:02,844 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37517. Reason: failure-to-start- 2837s 2024-11-24 00:54:02,844 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:02,844 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40281. Reason: failure-to-start- 2837s 2024-11-24 00:54:02,844 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:02,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35809': TLS handshake failed with remote 'tls://127.0.0.1:39752': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:02,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35809': TLS handshake failed with remote 'tls://127.0.0.1:39758': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:02,846 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:03,851 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:03,854 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40521 2837s 2024-11-24 00:54:03,855 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34107/status 2837s 2024-11-24 00:54:03,855 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:03,863 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35519 2837s 2024-11-24 00:54:03,863 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35519 2837s 2024-11-24 00:54:03,863 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:03,863 - distributed.worker - INFO - dashboard at: 127.0.0.1:32839 2837s 2024-11-24 00:54:03,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40521 2837s 2024-11-24 00:54:03,863 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:03,863 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:03,863 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:03,863 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g0hn96fs 2837s 2024-11-24 00:54:03,863 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:03,865 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37383 2837s 2024-11-24 00:54:03,865 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37383 2837s 2024-11-24 00:54:03,865 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:03,865 - distributed.worker - INFO - dashboard at: 127.0.0.1:40475 2837s 2024-11-24 00:54:03,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40521 2837s 2024-11-24 00:54:03,865 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:03,865 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:03,865 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:03,865 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6_pqkerw 2837s 2024-11-24 00:54:03,865 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:03,866 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35519. Reason: failure-to-start- 2837s 2024-11-24 00:54:03,866 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:03,866 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37383. Reason: failure-to-start- 2837s 2024-11-24 00:54:03,866 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:03,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40521': TLS handshake failed with remote 'tls://127.0.0.1:59148': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:03,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40521': TLS handshake failed with remote 'tls://127.0.0.1:59150': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:03,868 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:04,872 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:04,876 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40115 2837s 2024-11-24 00:54:04,876 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36317/status 2837s 2024-11-24 00:54:04,876 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:04,884 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46721 2837s 2024-11-24 00:54:04,884 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46721 2837s 2024-11-24 00:54:04,884 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:04,884 - distributed.worker - INFO - dashboard at: 127.0.0.1:42095 2837s 2024-11-24 00:54:04,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40115 2837s 2024-11-24 00:54:04,884 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:04,884 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:04,884 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:04,884 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h_dmnht5 2837s 2024-11-24 00:54:04,884 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:04,885 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41213 2837s 2024-11-24 00:54:04,885 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41213 2837s 2024-11-24 00:54:04,885 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:04,885 - distributed.worker - INFO - dashboard at: 127.0.0.1:36139 2837s 2024-11-24 00:54:04,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40115 2837s 2024-11-24 00:54:04,886 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:04,886 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:04,886 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:04,886 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ar3qeloo 2837s 2024-11-24 00:54:04,886 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:04,886 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46721. Reason: failure-to-start- 2837s 2024-11-24 00:54:04,886 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:04,887 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41213. Reason: failure-to-start- 2837s 2024-11-24 00:54:04,887 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:04,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40115': TLS handshake failed with remote 'tls://127.0.0.1:49598': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:04,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40115': TLS handshake failed with remote 'tls://127.0.0.1:49604': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:04,889 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:05,894 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:05,897 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34661 2837s 2024-11-24 00:54:05,898 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40907/status 2837s 2024-11-24 00:54:05,898 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:05,905 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42875 2837s 2024-11-24 00:54:05,905 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42875 2837s 2024-11-24 00:54:05,905 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:05,905 - distributed.worker - INFO - dashboard at: 127.0.0.1:45769 2837s 2024-11-24 00:54:05,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34661 2837s 2024-11-24 00:54:05,906 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:05,906 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:05,906 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:05,906 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bp6cckro 2837s 2024-11-24 00:54:05,906 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:05,907 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36135 2837s 2024-11-24 00:54:05,907 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36135 2837s 2024-11-24 00:54:05,907 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:05,907 - distributed.worker - INFO - dashboard at: 127.0.0.1:42285 2837s 2024-11-24 00:54:05,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34661 2837s 2024-11-24 00:54:05,907 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:05,907 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:05,907 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:05,907 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-73b3ilab 2837s 2024-11-24 00:54:05,908 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:05,908 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42875. Reason: failure-to-start- 2837s 2024-11-24 00:54:05,908 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:05,909 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36135. Reason: failure-to-start- 2837s 2024-11-24 00:54:05,909 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:05,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34661': TLS handshake failed with remote 'tls://127.0.0.1:46920': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:05,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34661': TLS handshake failed with remote 'tls://127.0.0.1:46936': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:05,910 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:06,915 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:06,920 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39165 2837s 2024-11-24 00:54:06,920 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33667/status 2837s 2024-11-24 00:54:06,920 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:06,928 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33679 2837s 2024-11-24 00:54:06,928 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33679 2837s 2024-11-24 00:54:06,928 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:06,928 - distributed.worker - INFO - dashboard at: 127.0.0.1:46491 2837s 2024-11-24 00:54:06,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39165 2837s 2024-11-24 00:54:06,929 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:06,929 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:06,929 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:06,929 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yexiq_5b 2837s 2024-11-24 00:54:06,929 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:06,930 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35749 2837s 2024-11-24 00:54:06,930 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35749 2837s 2024-11-24 00:54:06,930 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:06,931 - distributed.worker - INFO - dashboard at: 127.0.0.1:35041 2837s 2024-11-24 00:54:06,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39165 2837s 2024-11-24 00:54:06,931 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:06,931 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:06,931 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:06,931 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-beh671oe 2837s 2024-11-24 00:54:06,931 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:06,932 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33679. Reason: failure-to-start- 2837s 2024-11-24 00:54:06,932 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:06,932 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35749. Reason: failure-to-start- 2837s 2024-11-24 00:54:06,932 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:06,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39165': TLS handshake failed with remote 'tls://127.0.0.1:35806': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:06,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39165': TLS handshake failed with remote 'tls://127.0.0.1:35822': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:06,934 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:07,938 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:07,942 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39919 2837s 2024-11-24 00:54:07,943 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45589/status 2837s 2024-11-24 00:54:07,943 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:07,952 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35105 2837s 2024-11-24 00:54:07,952 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35105 2837s 2024-11-24 00:54:07,952 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:07,952 - distributed.worker - INFO - dashboard at: 127.0.0.1:46779 2837s 2024-11-24 00:54:07,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39919 2837s 2024-11-24 00:54:07,952 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:07,952 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:07,952 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:07,952 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_lk54pn9 2837s 2024-11-24 00:54:07,952 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:07,954 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44925 2837s 2024-11-24 00:54:07,954 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44925 2837s 2024-11-24 00:54:07,954 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:07,954 - distributed.worker - INFO - dashboard at: 127.0.0.1:45567 2837s 2024-11-24 00:54:07,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39919 2837s 2024-11-24 00:54:07,954 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:07,954 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:07,954 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:07,954 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jqssqev_ 2837s 2024-11-24 00:54:07,954 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:07,955 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35105. Reason: failure-to-start- 2837s 2024-11-24 00:54:07,955 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:07,956 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44925. Reason: failure-to-start- 2837s 2024-11-24 00:54:07,956 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:07,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39919': TLS handshake failed with remote 'tls://127.0.0.1:49532': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:07,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39919': TLS handshake failed with remote 'tls://127.0.0.1:49536': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:07,958 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:08,962 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:08,966 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42893 2837s 2024-11-24 00:54:08,966 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37571/status 2837s 2024-11-24 00:54:08,966 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:08,975 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40937 2837s 2024-11-24 00:54:08,975 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40937 2837s 2024-11-24 00:54:08,975 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:08,975 - distributed.worker - INFO - dashboard at: 127.0.0.1:33245 2837s 2024-11-24 00:54:08,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42893 2837s 2024-11-24 00:54:08,975 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:08,975 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:08,975 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:08,975 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a30qz9kw 2837s 2024-11-24 00:54:08,975 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:08,977 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42553 2837s 2024-11-24 00:54:08,977 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42553 2837s 2024-11-24 00:54:08,977 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:08,977 - distributed.worker - INFO - dashboard at: 127.0.0.1:43097 2837s 2024-11-24 00:54:08,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42893 2837s 2024-11-24 00:54:08,977 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:08,977 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:08,977 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:08,977 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8w5zjnws 2837s 2024-11-24 00:54:08,977 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:08,979 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40937. Reason: failure-to-start- 2837s 2024-11-24 00:54:08,979 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:08,979 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42553. Reason: failure-to-start- 2837s 2024-11-24 00:54:08,979 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:08,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42893': TLS handshake failed with remote 'tls://127.0.0.1:55274': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:08,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42893': TLS handshake failed with remote 'tls://127.0.0.1:55290': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:08,981 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:09,986 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:09,990 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39841 2837s 2024-11-24 00:54:09,990 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43283/status 2837s 2024-11-24 00:54:09,991 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:09,999 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42427 2837s 2024-11-24 00:54:10,000 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42427 2837s 2024-11-24 00:54:10,000 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:10,000 - distributed.worker - INFO - dashboard at: 127.0.0.1:42367 2837s 2024-11-24 00:54:10,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39841 2837s 2024-11-24 00:54:10,000 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:10,000 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:10,000 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:10,000 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-339w718u 2837s 2024-11-24 00:54:10,000 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:10,002 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42381 2837s 2024-11-24 00:54:10,002 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42381 2837s 2024-11-24 00:54:10,002 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:10,002 - distributed.worker - INFO - dashboard at: 127.0.0.1:34459 2837s 2024-11-24 00:54:10,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39841 2837s 2024-11-24 00:54:10,002 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:10,002 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:10,002 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:10,002 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cs3jvybk 2837s 2024-11-24 00:54:10,002 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:10,003 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42427. Reason: failure-to-start- 2837s 2024-11-24 00:54:10,003 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:10,003 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42381. Reason: failure-to-start- 2837s 2024-11-24 00:54:10,003 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:10,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39841': TLS handshake failed with remote 'tls://127.0.0.1:51430': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:10,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39841': TLS handshake failed with remote 'tls://127.0.0.1:51442': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:10,005 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:11,010 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:11,015 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40771 2837s 2024-11-24 00:54:11,016 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39093/status 2837s 2024-11-24 00:54:11,016 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:11,024 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45839 2837s 2024-11-24 00:54:11,025 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45839 2837s 2024-11-24 00:54:11,025 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:11,025 - distributed.worker - INFO - dashboard at: 127.0.0.1:33367 2837s 2024-11-24 00:54:11,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40771 2837s 2024-11-24 00:54:11,025 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:11,025 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:11,025 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:11,025 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9snc90jy 2837s 2024-11-24 00:54:11,025 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:11,026 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46779 2837s 2024-11-24 00:54:11,027 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46779 2837s 2024-11-24 00:54:11,027 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:11,027 - distributed.worker - INFO - dashboard at: 127.0.0.1:40999 2837s 2024-11-24 00:54:11,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40771 2837s 2024-11-24 00:54:11,027 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:11,027 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:11,027 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:11,027 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-87er1p3z 2837s 2024-11-24 00:54:11,027 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:11,028 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45839. Reason: failure-to-start- 2837s 2024-11-24 00:54:11,028 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:11,028 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46779. Reason: failure-to-start- 2837s 2024-11-24 00:54:11,028 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:11,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40771': TLS handshake failed with remote 'tls://127.0.0.1:33808': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:11,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40771': TLS handshake failed with remote 'tls://127.0.0.1:33824': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:11,030 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:12,035 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:12,039 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43701 2837s 2024-11-24 00:54:12,039 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43523/status 2837s 2024-11-24 00:54:12,039 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:12,050 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41533 2837s 2024-11-24 00:54:12,050 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41533 2837s 2024-11-24 00:54:12,050 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:12,050 - distributed.worker - INFO - dashboard at: 127.0.0.1:32917 2837s 2024-11-24 00:54:12,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43701 2837s 2024-11-24 00:54:12,050 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:12,050 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:12,050 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:12,050 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v1vavbea 2837s 2024-11-24 00:54:12,050 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:12,052 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46245 2837s 2024-11-24 00:54:12,052 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46245 2837s 2024-11-24 00:54:12,052 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:12,052 - distributed.worker - INFO - dashboard at: 127.0.0.1:37385 2837s 2024-11-24 00:54:12,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43701 2837s 2024-11-24 00:54:12,052 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:12,052 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:12,052 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:12,052 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2gn1n2sh 2837s 2024-11-24 00:54:12,052 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:12,053 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41533. Reason: failure-to-start- 2837s 2024-11-24 00:54:12,053 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:12,054 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46245. Reason: failure-to-start- 2837s 2024-11-24 00:54:12,054 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:12,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43701': TLS handshake failed with remote 'tls://127.0.0.1:36926': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:12,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43701': TLS handshake failed with remote 'tls://127.0.0.1:36930': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:12,056 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:13,060 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:13,064 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40953 2837s 2024-11-24 00:54:13,064 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38407/status 2837s 2024-11-24 00:54:13,065 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:13,073 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34515 2837s 2024-11-24 00:54:13,074 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34515 2837s 2024-11-24 00:54:13,074 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:13,074 - distributed.worker - INFO - dashboard at: 127.0.0.1:38571 2837s 2024-11-24 00:54:13,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40953 2837s 2024-11-24 00:54:13,074 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:13,074 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:13,074 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:13,074 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mipt4h89 2837s 2024-11-24 00:54:13,074 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:13,076 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38653 2837s 2024-11-24 00:54:13,076 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38653 2837s 2024-11-24 00:54:13,076 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:13,076 - distributed.worker - INFO - dashboard at: 127.0.0.1:37093 2837s 2024-11-24 00:54:13,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40953 2837s 2024-11-24 00:54:13,076 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:13,076 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:13,076 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:13,076 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sabds64f 2837s 2024-11-24 00:54:13,076 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:13,078 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34515. Reason: failure-to-start- 2837s 2024-11-24 00:54:13,078 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:13,078 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38653. Reason: failure-to-start- 2837s 2024-11-24 00:54:13,078 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:13,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40953': TLS handshake failed with remote 'tls://127.0.0.1:34020': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:13,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40953': TLS handshake failed with remote 'tls://127.0.0.1:34036': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:13,081 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:14,085 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:14,089 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39793 2837s 2024-11-24 00:54:14,090 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33139/status 2837s 2024-11-24 00:54:14,090 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:14,098 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42419 2837s 2024-11-24 00:54:14,098 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42419 2837s 2024-11-24 00:54:14,098 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:14,098 - distributed.worker - INFO - dashboard at: 127.0.0.1:36353 2837s 2024-11-24 00:54:14,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39793 2837s 2024-11-24 00:54:14,099 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:14,099 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:14,099 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:14,099 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6ofq7b89 2837s 2024-11-24 00:54:14,099 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:14,100 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35313 2837s 2024-11-24 00:54:14,100 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35313 2837s 2024-11-24 00:54:14,100 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:14,100 - distributed.worker - INFO - dashboard at: 127.0.0.1:35115 2837s 2024-11-24 00:54:14,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39793 2837s 2024-11-24 00:54:14,101 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:14,101 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:14,101 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:14,101 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kcvgf6j8 2837s 2024-11-24 00:54:14,101 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:14,102 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42419. Reason: failure-to-start- 2837s 2024-11-24 00:54:14,102 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:14,102 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35313. Reason: failure-to-start- 2837s 2024-11-24 00:54:14,102 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:14,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39793': TLS handshake failed with remote 'tls://127.0.0.1:35080': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:14,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39793': TLS handshake failed with remote 'tls://127.0.0.1:35088': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:14,104 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:15,109 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:15,123 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38625 2837s 2024-11-24 00:54:15,123 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45757/status 2837s 2024-11-24 00:54:15,123 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:15,132 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42617 2837s 2024-11-24 00:54:15,132 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42617 2837s 2024-11-24 00:54:15,133 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:15,133 - distributed.worker - INFO - dashboard at: 127.0.0.1:44971 2837s 2024-11-24 00:54:15,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38625 2837s 2024-11-24 00:54:15,133 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:15,133 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:15,133 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:15,133 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-53m0lvxo 2837s 2024-11-24 00:54:15,133 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:15,134 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43047 2837s 2024-11-24 00:54:15,134 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43047 2837s 2024-11-24 00:54:15,134 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:15,134 - distributed.worker - INFO - dashboard at: 127.0.0.1:33387 2837s 2024-11-24 00:54:15,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38625 2837s 2024-11-24 00:54:15,135 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:15,135 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:15,135 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:15,135 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yw15odmf 2837s 2024-11-24 00:54:15,135 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:15,136 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42617. Reason: failure-to-start- 2837s 2024-11-24 00:54:15,136 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:15,136 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43047. Reason: failure-to-start- 2837s 2024-11-24 00:54:15,136 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:15,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38625': TLS handshake failed with remote 'tls://127.0.0.1:37844': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:15,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38625': TLS handshake failed with remote 'tls://127.0.0.1:37856': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:15,138 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:16,143 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:16,147 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45573 2837s 2024-11-24 00:54:16,147 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44187/status 2837s 2024-11-24 00:54:16,147 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:16,158 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37513 2837s 2024-11-24 00:54:16,158 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37513 2837s 2024-11-24 00:54:16,158 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:16,158 - distributed.worker - INFO - dashboard at: 127.0.0.1:42223 2837s 2024-11-24 00:54:16,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45573 2837s 2024-11-24 00:54:16,158 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:16,158 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:16,158 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:16,158 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cflsga2h 2837s 2024-11-24 00:54:16,159 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:16,160 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46085 2837s 2024-11-24 00:54:16,160 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46085 2837s 2024-11-24 00:54:16,160 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:16,160 - distributed.worker - INFO - dashboard at: 127.0.0.1:42235 2837s 2024-11-24 00:54:16,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45573 2837s 2024-11-24 00:54:16,160 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:16,160 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:16,160 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:16,161 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s_94c5mo 2837s 2024-11-24 00:54:16,161 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:16,161 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37513. Reason: failure-to-start- 2837s 2024-11-24 00:54:16,162 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:16,162 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46085. Reason: failure-to-start- 2837s 2024-11-24 00:54:16,162 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:16,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45573': TLS handshake failed with remote 'tls://127.0.0.1:37616': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:16,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45573': TLS handshake failed with remote 'tls://127.0.0.1:37624': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:16,164 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:17,169 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:17,173 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34601 2837s 2024-11-24 00:54:17,173 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33815/status 2837s 2024-11-24 00:54:17,173 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:17,182 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45069 2837s 2024-11-24 00:54:17,182 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45069 2837s 2024-11-24 00:54:17,182 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:17,182 - distributed.worker - INFO - dashboard at: 127.0.0.1:34325 2837s 2024-11-24 00:54:17,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34601 2837s 2024-11-24 00:54:17,182 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:17,182 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:17,182 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:17,182 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4iwl949v 2837s 2024-11-24 00:54:17,182 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:17,184 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39013 2837s 2024-11-24 00:54:17,184 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39013 2837s 2024-11-24 00:54:17,184 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:17,184 - distributed.worker - INFO - dashboard at: 127.0.0.1:33631 2837s 2024-11-24 00:54:17,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34601 2837s 2024-11-24 00:54:17,184 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:17,184 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:17,184 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:17,184 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fq0g_v95 2837s 2024-11-24 00:54:17,184 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:17,185 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45069. Reason: failure-to-start- 2837s 2024-11-24 00:54:17,185 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:17,186 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39013. Reason: failure-to-start- 2837s 2024-11-24 00:54:17,186 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:17,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34601': TLS handshake failed with remote 'tls://127.0.0.1:55198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:17,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34601': TLS handshake failed with remote 'tls://127.0.0.1:55202': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:17,187 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:18,194 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:18,198 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45275 2837s 2024-11-24 00:54:18,198 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35739/status 2837s 2024-11-24 00:54:18,199 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:18,207 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44445 2837s 2024-11-24 00:54:18,207 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44445 2837s 2024-11-24 00:54:18,207 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:18,207 - distributed.worker - INFO - dashboard at: 127.0.0.1:42655 2837s 2024-11-24 00:54:18,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45275 2837s 2024-11-24 00:54:18,208 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:18,208 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:18,208 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:18,208 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7hdyveh2 2837s 2024-11-24 00:54:18,208 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:18,209 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32899 2837s 2024-11-24 00:54:18,209 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32899 2837s 2024-11-24 00:54:18,209 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:18,209 - distributed.worker - INFO - dashboard at: 127.0.0.1:39245 2837s 2024-11-24 00:54:18,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45275 2837s 2024-11-24 00:54:18,209 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:18,209 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:18,209 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:18,209 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gycsbr7b 2837s 2024-11-24 00:54:18,209 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:18,210 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44445. Reason: failure-to-start- 2837s 2024-11-24 00:54:18,210 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:18,210 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32899. Reason: failure-to-start- 2837s 2024-11-24 00:54:18,211 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:18,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45275': TLS handshake failed with remote 'tls://127.0.0.1:47896': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:18,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45275': TLS handshake failed with remote 'tls://127.0.0.1:47912': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:18,212 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:19,217 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:19,221 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45397 2837s 2024-11-24 00:54:19,221 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42853/status 2837s 2024-11-24 00:54:19,221 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:19,230 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42039 2837s 2024-11-24 00:54:19,230 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42039 2837s 2024-11-24 00:54:19,230 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:19,230 - distributed.worker - INFO - dashboard at: 127.0.0.1:43525 2837s 2024-11-24 00:54:19,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45397 2837s 2024-11-24 00:54:19,230 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:19,230 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:19,230 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:19,231 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r8td1sc0 2837s 2024-11-24 00:54:19,231 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:19,232 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44817 2837s 2024-11-24 00:54:19,232 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44817 2837s 2024-11-24 00:54:19,232 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:19,232 - distributed.worker - INFO - dashboard at: 127.0.0.1:42045 2837s 2024-11-24 00:54:19,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45397 2837s 2024-11-24 00:54:19,232 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:19,232 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:19,232 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:19,232 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-slrzurif 2837s 2024-11-24 00:54:19,232 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:19,233 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42039. Reason: failure-to-start- 2837s 2024-11-24 00:54:19,233 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:19,234 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44817. Reason: failure-to-start- 2837s 2024-11-24 00:54:19,234 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:19,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45397': TLS handshake failed with remote 'tls://127.0.0.1:57190': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:19,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45397': TLS handshake failed with remote 'tls://127.0.0.1:57200': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:19,236 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:20,240 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:20,244 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40221 2837s 2024-11-24 00:54:20,244 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36073/status 2837s 2024-11-24 00:54:20,244 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:20,253 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39479 2837s 2024-11-24 00:54:20,253 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39479 2837s 2024-11-24 00:54:20,253 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:20,253 - distributed.worker - INFO - dashboard at: 127.0.0.1:44703 2837s 2024-11-24 00:54:20,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40221 2837s 2024-11-24 00:54:20,254 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:20,254 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:20,254 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:20,254 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9esyvqgq 2837s 2024-11-24 00:54:20,254 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:20,256 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32837 2837s 2024-11-24 00:54:20,256 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32837 2837s 2024-11-24 00:54:20,256 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:20,256 - distributed.worker - INFO - dashboard at: 127.0.0.1:38973 2837s 2024-11-24 00:54:20,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40221 2837s 2024-11-24 00:54:20,256 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:20,256 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:20,256 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:20,256 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7u7jams1 2837s 2024-11-24 00:54:20,256 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:20,257 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39479. Reason: failure-to-start- 2837s 2024-11-24 00:54:20,257 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:20,257 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32837. Reason: failure-to-start- 2837s 2024-11-24 00:54:20,258 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:20,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40221': TLS handshake failed with remote 'tls://127.0.0.1:46600': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:20,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40221': TLS handshake failed with remote 'tls://127.0.0.1:46616': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:20,259 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:21,264 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:21,268 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46799 2837s 2024-11-24 00:54:21,268 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38523/status 2837s 2024-11-24 00:54:21,268 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:21,277 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40343 2837s 2024-11-24 00:54:21,277 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40343 2837s 2024-11-24 00:54:21,277 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:21,277 - distributed.worker - INFO - dashboard at: 127.0.0.1:40597 2837s 2024-11-24 00:54:21,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46799 2837s 2024-11-24 00:54:21,277 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:21,277 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:21,277 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:21,277 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zqfbp1kk 2837s 2024-11-24 00:54:21,277 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:21,279 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32769 2837s 2024-11-24 00:54:21,279 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32769 2837s 2024-11-24 00:54:21,279 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:21,279 - distributed.worker - INFO - dashboard at: 127.0.0.1:37407 2837s 2024-11-24 00:54:21,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46799 2837s 2024-11-24 00:54:21,279 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:21,279 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:21,279 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:21,279 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ht6lrj2y 2837s 2024-11-24 00:54:21,279 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:21,280 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40343. Reason: failure-to-start- 2837s 2024-11-24 00:54:21,280 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:21,280 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32769. Reason: failure-to-start- 2837s 2024-11-24 00:54:21,280 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:21,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46799': TLS handshake failed with remote 'tls://127.0.0.1:45196': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:21,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46799': TLS handshake failed with remote 'tls://127.0.0.1:45206': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:21,282 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:22,287 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:22,291 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34037 2837s 2024-11-24 00:54:22,292 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44363/status 2837s 2024-11-24 00:54:22,292 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:22,300 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42511 2837s 2024-11-24 00:54:22,300 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42511 2837s 2024-11-24 00:54:22,300 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:22,300 - distributed.worker - INFO - dashboard at: 127.0.0.1:41575 2837s 2024-11-24 00:54:22,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34037 2837s 2024-11-24 00:54:22,300 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:22,300 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:22,300 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:22,300 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gs3xz206 2837s 2024-11-24 00:54:22,301 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:22,302 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41159 2837s 2024-11-24 00:54:22,302 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41159 2837s 2024-11-24 00:54:22,302 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:22,302 - distributed.worker - INFO - dashboard at: 127.0.0.1:42655 2837s 2024-11-24 00:54:22,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34037 2837s 2024-11-24 00:54:22,302 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:22,302 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:22,302 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:22,302 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iccredmj 2837s 2024-11-24 00:54:22,302 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:22,304 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42511. Reason: failure-to-start- 2837s 2024-11-24 00:54:22,304 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:22,304 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41159. Reason: failure-to-start- 2837s 2024-11-24 00:54:22,304 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:22,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34037': TLS handshake failed with remote 'tls://127.0.0.1:56188': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:22,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34037': TLS handshake failed with remote 'tls://127.0.0.1:56190': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:22,306 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:23,311 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:23,315 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34735 2837s 2024-11-24 00:54:23,315 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34583/status 2837s 2024-11-24 00:54:23,316 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:23,331 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38105 2837s 2024-11-24 00:54:23,331 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38105 2837s 2024-11-24 00:54:23,331 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:23,331 - distributed.worker - INFO - dashboard at: 127.0.0.1:37371 2837s 2024-11-24 00:54:23,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34735 2837s 2024-11-24 00:54:23,331 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:23,331 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:23,331 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:23,331 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b7pf91nq 2837s 2024-11-24 00:54:23,331 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:23,333 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44237 2837s 2024-11-24 00:54:23,333 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44237 2837s 2024-11-24 00:54:23,333 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:23,333 - distributed.worker - INFO - dashboard at: 127.0.0.1:39889 2837s 2024-11-24 00:54:23,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34735 2837s 2024-11-24 00:54:23,333 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:23,333 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:23,333 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:23,333 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k8bqp6fq 2837s 2024-11-24 00:54:23,334 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:23,334 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38105. Reason: failure-to-start- 2837s 2024-11-24 00:54:23,335 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:23,335 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44237. Reason: failure-to-start- 2837s 2024-11-24 00:54:23,335 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:23,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34735': TLS handshake failed with remote 'tls://127.0.0.1:41684': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:23,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34735': TLS handshake failed with remote 'tls://127.0.0.1:41698': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:23,340 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:24,355 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:24,359 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44943 2837s 2024-11-24 00:54:24,359 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37583/status 2837s 2024-11-24 00:54:24,359 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:24,370 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41785 2837s 2024-11-24 00:54:24,371 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41785 2837s 2024-11-24 00:54:24,371 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:24,371 - distributed.worker - INFO - dashboard at: 127.0.0.1:40025 2837s 2024-11-24 00:54:24,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44943 2837s 2024-11-24 00:54:24,371 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:24,371 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:24,371 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:24,371 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kqtyc5el 2837s 2024-11-24 00:54:24,371 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:24,372 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39335 2837s 2024-11-24 00:54:24,373 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39335 2837s 2024-11-24 00:54:24,373 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:24,373 - distributed.worker - INFO - dashboard at: 127.0.0.1:40825 2837s 2024-11-24 00:54:24,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44943 2837s 2024-11-24 00:54:24,373 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:24,373 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:24,373 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:24,373 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fbfmctoa 2837s 2024-11-24 00:54:24,373 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:24,374 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41785. Reason: failure-to-start- 2837s 2024-11-24 00:54:24,374 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:24,374 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39335. Reason: failure-to-start- 2837s 2024-11-24 00:54:24,375 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:24,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44943': TLS handshake failed with remote 'tls://127.0.0.1:44736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:24,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44943': TLS handshake failed with remote 'tls://127.0.0.1:44740': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:24,377 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:25,381 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:25,385 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44089 2837s 2024-11-24 00:54:25,385 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41167/status 2837s 2024-11-24 00:54:25,385 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:25,394 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44235 2837s 2024-11-24 00:54:25,394 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44235 2837s 2024-11-24 00:54:25,394 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:25,394 - distributed.worker - INFO - dashboard at: 127.0.0.1:46465 2837s 2024-11-24 00:54:25,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44089 2837s 2024-11-24 00:54:25,394 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:25,394 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:25,394 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:25,394 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b3wpuql0 2837s 2024-11-24 00:54:25,394 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:25,396 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39225 2837s 2024-11-24 00:54:25,396 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39225 2837s 2024-11-24 00:54:25,396 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:25,396 - distributed.worker - INFO - dashboard at: 127.0.0.1:40411 2837s 2024-11-24 00:54:25,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44089 2837s 2024-11-24 00:54:25,396 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:25,396 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:25,396 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:25,396 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5row4jca 2837s 2024-11-24 00:54:25,396 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:25,397 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44235. Reason: failure-to-start- 2837s 2024-11-24 00:54:25,397 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:25,398 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39225. Reason: failure-to-start- 2837s 2024-11-24 00:54:25,398 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:25,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44089': TLS handshake failed with remote 'tls://127.0.0.1:59284': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:25,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44089': TLS handshake failed with remote 'tls://127.0.0.1:59300': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:25,401 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:26,405 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:26,409 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41707 2837s 2024-11-24 00:54:26,410 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35973/status 2837s 2024-11-24 00:54:26,410 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:26,418 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41519 2837s 2024-11-24 00:54:26,419 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41519 2837s 2024-11-24 00:54:26,419 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:26,419 - distributed.worker - INFO - dashboard at: 127.0.0.1:38289 2837s 2024-11-24 00:54:26,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41707 2837s 2024-11-24 00:54:26,419 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:26,419 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:26,419 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:26,419 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0s_dgf8y 2837s 2024-11-24 00:54:26,419 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:26,420 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45199 2837s 2024-11-24 00:54:26,421 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45199 2837s 2024-11-24 00:54:26,421 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:26,421 - distributed.worker - INFO - dashboard at: 127.0.0.1:46323 2837s 2024-11-24 00:54:26,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41707 2837s 2024-11-24 00:54:26,421 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:26,421 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:26,421 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:26,421 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x0wl_de3 2837s 2024-11-24 00:54:26,421 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:26,422 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41519. Reason: failure-to-start- 2837s 2024-11-24 00:54:26,422 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:26,422 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45199. Reason: failure-to-start- 2837s 2024-11-24 00:54:26,422 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:26,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41707': TLS handshake failed with remote 'tls://127.0.0.1:36092': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:26,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41707': TLS handshake failed with remote 'tls://127.0.0.1:36108': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:26,425 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:27,430 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:27,436 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42349 2837s 2024-11-24 00:54:27,436 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45345/status 2837s 2024-11-24 00:54:27,436 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:27,444 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43799 2837s 2024-11-24 00:54:27,444 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43799 2837s 2024-11-24 00:54:27,444 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:27,444 - distributed.worker - INFO - dashboard at: 127.0.0.1:37181 2837s 2024-11-24 00:54:27,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42349 2837s 2024-11-24 00:54:27,444 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:27,444 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:27,445 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:27,445 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tu594cnf 2837s 2024-11-24 00:54:27,445 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:27,446 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46327 2837s 2024-11-24 00:54:27,446 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46327 2837s 2024-11-24 00:54:27,446 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:27,446 - distributed.worker - INFO - dashboard at: 127.0.0.1:38799 2837s 2024-11-24 00:54:27,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42349 2837s 2024-11-24 00:54:27,446 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:27,446 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:27,446 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:27,446 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_fezmfkf 2837s 2024-11-24 00:54:27,446 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:27,448 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43799. Reason: failure-to-start- 2837s 2024-11-24 00:54:27,448 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:27,448 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46327. Reason: failure-to-start- 2837s 2024-11-24 00:54:27,448 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:27,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42349': TLS handshake failed with remote 'tls://127.0.0.1:50022': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:27,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42349': TLS handshake failed with remote 'tls://127.0.0.1:50026': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:27,450 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:28,455 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:28,459 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35963 2837s 2024-11-24 00:54:28,459 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34245/status 2837s 2024-11-24 00:54:28,459 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:28,470 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46759 2837s 2024-11-24 00:54:28,470 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46759 2837s 2024-11-24 00:54:28,470 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:28,470 - distributed.worker - INFO - dashboard at: 127.0.0.1:33697 2837s 2024-11-24 00:54:28,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35963 2837s 2024-11-24 00:54:28,470 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:28,470 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:28,470 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:28,470 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-avgdqaim 2837s 2024-11-24 00:54:28,470 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:28,472 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40269 2837s 2024-11-24 00:54:28,472 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40269 2837s 2024-11-24 00:54:28,472 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:28,472 - distributed.worker - INFO - dashboard at: 127.0.0.1:35229 2837s 2024-11-24 00:54:28,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35963 2837s 2024-11-24 00:54:28,472 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:28,472 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:28,472 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:28,472 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cyceld6d 2837s 2024-11-24 00:54:28,472 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:28,474 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46759. Reason: failure-to-start- 2837s 2024-11-24 00:54:28,474 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:28,474 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40269. Reason: failure-to-start- 2837s 2024-11-24 00:54:28,474 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:28,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35963': TLS handshake failed with remote 'tls://127.0.0.1:39052': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:28,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35963': TLS handshake failed with remote 'tls://127.0.0.1:39064': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:28,476 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:29,480 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:29,484 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41967 2837s 2024-11-24 00:54:29,485 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34953/status 2837s 2024-11-24 00:54:29,485 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:29,493 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41127 2837s 2024-11-24 00:54:29,493 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41127 2837s 2024-11-24 00:54:29,493 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:29,493 - distributed.worker - INFO - dashboard at: 127.0.0.1:33019 2837s 2024-11-24 00:54:29,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41967 2837s 2024-11-24 00:54:29,493 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:29,493 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:29,493 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:29,493 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-00pqtps0 2837s 2024-11-24 00:54:29,493 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:29,495 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33295 2837s 2024-11-24 00:54:29,495 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33295 2837s 2024-11-24 00:54:29,495 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:29,495 - distributed.worker - INFO - dashboard at: 127.0.0.1:36863 2837s 2024-11-24 00:54:29,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41967 2837s 2024-11-24 00:54:29,495 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:29,495 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:29,496 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:29,496 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p6fjak1y 2837s 2024-11-24 00:54:29,496 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:29,498 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41127. Reason: failure-to-start- 2837s 2024-11-24 00:54:29,498 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:29,498 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33295. Reason: failure-to-start- 2837s 2024-11-24 00:54:29,498 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:29,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41967': TLS handshake failed with remote 'tls://127.0.0.1:59478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:29,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41967': TLS handshake failed with remote 'tls://127.0.0.1:59494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:29,501 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:30,506 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:30,510 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37035 2837s 2024-11-24 00:54:30,510 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42183/status 2837s 2024-11-24 00:54:30,510 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:30,520 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39915 2837s 2024-11-24 00:54:30,520 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39915 2837s 2024-11-24 00:54:30,520 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:30,520 - distributed.worker - INFO - dashboard at: 127.0.0.1:42799 2837s 2024-11-24 00:54:30,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37035 2837s 2024-11-24 00:54:30,520 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:30,520 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:30,520 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:30,520 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jvb2uzwn 2837s 2024-11-24 00:54:30,520 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:30,522 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37239 2837s 2024-11-24 00:54:30,522 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37239 2837s 2024-11-24 00:54:30,522 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:30,522 - distributed.worker - INFO - dashboard at: 127.0.0.1:43303 2837s 2024-11-24 00:54:30,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37035 2837s 2024-11-24 00:54:30,522 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:30,522 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:30,522 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:30,522 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-og6vrh4p 2837s 2024-11-24 00:54:30,522 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:30,524 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39915. Reason: failure-to-start- 2837s 2024-11-24 00:54:30,524 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:30,525 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37239. Reason: failure-to-start- 2837s 2024-11-24 00:54:30,525 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:30,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37035': TLS handshake failed with remote 'tls://127.0.0.1:53758': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:30,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37035': TLS handshake failed with remote 'tls://127.0.0.1:53762': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:30,527 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:31,542 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:31,547 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37559 2837s 2024-11-24 00:54:31,547 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45781/status 2837s 2024-11-24 00:54:31,547 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:31,558 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45893 2837s 2024-11-24 00:54:31,558 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45893 2837s 2024-11-24 00:54:31,558 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:31,559 - distributed.worker - INFO - dashboard at: 127.0.0.1:43069 2837s 2024-11-24 00:54:31,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37559 2837s 2024-11-24 00:54:31,559 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:31,559 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:31,559 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:31,559 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ypylscpi 2837s 2024-11-24 00:54:31,559 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:31,560 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34299 2837s 2024-11-24 00:54:31,561 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34299 2837s 2024-11-24 00:54:31,561 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:31,561 - distributed.worker - INFO - dashboard at: 127.0.0.1:46331 2837s 2024-11-24 00:54:31,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37559 2837s 2024-11-24 00:54:31,561 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:31,561 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:31,561 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:31,561 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g4juv5j7 2837s 2024-11-24 00:54:31,561 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:31,562 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45893. Reason: failure-to-start- 2837s 2024-11-24 00:54:31,562 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:31,562 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34299. Reason: failure-to-start- 2837s 2024-11-24 00:54:31,562 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:31,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37559': TLS handshake failed with remote 'tls://127.0.0.1:52576': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:31,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37559': TLS handshake failed with remote 'tls://127.0.0.1:52592': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:31,564 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:54:32,568 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:32,573 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39173 2837s 2024-11-24 00:54:32,573 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37645/status 2837s 2024-11-24 00:54:32,573 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:32,898 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36507 2837s 2024-11-24 00:54:32,898 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36507 2837s 2024-11-24 00:54:32,898 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:54:32,898 - distributed.worker - INFO - dashboard at: 127.0.0.1:41169 2837s 2024-11-24 00:54:32,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39173 2837s 2024-11-24 00:54:32,898 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:32,899 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:54:32,899 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:32,899 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kqvnb2_e 2837s 2024-11-24 00:54:32,899 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:32,900 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46597 2837s 2024-11-24 00:54:32,900 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46597 2837s 2024-11-24 00:54:32,900 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:54:32,900 - distributed.worker - INFO - dashboard at: 127.0.0.1:34127 2837s 2024-11-24 00:54:32,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39173 2837s 2024-11-24 00:54:32,900 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:32,901 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:54:32,901 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:54:32,901 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4jy2a2xi 2837s 2024-11-24 00:54:32,901 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:54:32,916 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36507. Reason: worker-close 2837s 2024-11-24 00:54:32,916 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:32,916 - distributed.worker - INFO - Not waiting on executor to close 2837s 2024-11-24 00:54:32,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39173': TLS handshake failed with remote 'tls://127.0.0.1:35122': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:32,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39173': TLS handshake failed with remote 'tls://127.0.0.1:35134': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:54:32,919 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46597. Reason: worker-close 2837s 2024-11-24 00:54:32,919 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:54:32,919 - distributed.worker - INFO - Not waiting on executor to close 2837s _____________________________ test_retire_workers ______________________________ 2837s 2837s fut = , timeout = 0 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s /usr/lib/python3/dist-packages/distributed/core.py:1620: in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s /usr/lib/python3/dist-packages/distributed/core.py:1564: in _connect 2837s comm = await connect( 2837s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2837s comm = await wait_for( 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2837s return await fut 2837s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 2837s stream = await self.client.connect( 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s host = '127.0.0.1', port = 41461, af = 2837s ssl_options = 2837s max_buffer_size = 4151066624.0, source_ip = None, source_port = None 2837s timeout = None 2837s 2837s async def connect( 2837s self, 2837s host: str, 2837s port: int, 2837s af: socket.AddressFamily = socket.AF_UNSPEC, 2837s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 2837s max_buffer_size: Optional[int] = None, 2837s source_ip: Optional[str] = None, 2837s source_port: Optional[int] = None, 2837s timeout: Optional[Union[float, datetime.timedelta]] = None, 2837s ) -> IOStream: 2837s """Connect to the given host and port. 2837s 2837s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 2837s ``ssl_options`` is not None). 2837s 2837s Using the ``source_ip`` kwarg, one can specify the source 2837s IP address to use when establishing the connection. 2837s In case the user needs to resolve and 2837s use a specific interface, it has to be handled outside 2837s of Tornado as this depends very much on the platform. 2837s 2837s Raises `TimeoutError` if the input future does not complete before 2837s ``timeout``, which may be specified in any form allowed by 2837s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 2837s relative to `.IOLoop.time`) 2837s 2837s Similarly, when the user requires a certain source port, it can 2837s be specified using the ``source_port`` arg. 2837s 2837s .. versionchanged:: 4.5 2837s Added the ``source_ip`` and ``source_port`` arguments. 2837s 2837s .. versionchanged:: 5.0 2837s Added the ``timeout`` argument. 2837s """ 2837s if timeout is not None: 2837s if isinstance(timeout, numbers.Real): 2837s timeout = IOLoop.current().time() + timeout 2837s elif isinstance(timeout, datetime.timedelta): 2837s timeout = IOLoop.current().time() + timeout.total_seconds() 2837s else: 2837s raise TypeError("Unsupported timeout %r" % timeout) 2837s if timeout is not None: 2837s addrinfo = await gen.with_timeout( 2837s timeout, self.resolver.resolve(host, port, af) 2837s ) 2837s else: 2837s addrinfo = await self.resolver.resolve(host, port, af) 2837s connector = _Connector( 2837s addrinfo, 2837s functools.partial( 2837s self._create_stream, 2837s max_buffer_size, 2837s source_ip=source_ip, 2837s source_port=source_port, 2837s ), 2837s ) 2837s > af, addr, stream = await connector.start(connect_timeout=timeout) 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s > await wait_for(self.start_unsafe(), timeout=timeout) 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:664: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s @contextlib.asynccontextmanager 2837s async def _cluster_factory(): 2837s workers = [] 2837s s = None 2837s try: 2837s for _ in range(60): 2837s try: 2837s > s, ws = await start_cluster( 2837s nthreads, 2837s scheduler, 2837s security=security, 2837s Worker=Worker, 2837s scheduler_kwargs=scheduler_kwargs, 2837s worker_kwargs=merge( 2837s {"death_timeout": min(15, int(deadline.remaining))}, 2837s worker_kwargs, 2837s ), 2837s ) 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 2837s await asyncio.gather(*workers) 2837s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 2837s return await awaitable 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s except asyncio.TimeoutError as exc: 2837s await _close_on_failure(exc) 2837s > raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s E TimeoutError: Nanny start timed out after 0s. 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s fut = ._..test_func..async_fn at 0xe63f7717abc0> 2837s timeout = 60 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 2837s _cluster_factory() as (s, workers), 2837s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 2837s return await anext(self.gen) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 2837s await asyncio.sleep(1) 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s delay = 1, result = None 2837s 2837s async def sleep(delay, result=None): 2837s """Coroutine that completes after a given time (in seconds).""" 2837s if delay <= 0: 2837s await __sleep0() 2837s return result 2837s 2837s if math.isnan(delay): 2837s raise ValueError("Invalid delay: NaN (not a number)") 2837s 2837s loop = events.get_running_loop() 2837s future = loop.create_future() 2837s h = loop.call_later(delay, 2837s futures._set_result_unless_cancelled, 2837s future, result) 2837s try: 2837s > return await future 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s args = (), kwds = {} 2837s 2837s @wraps(func) 2837s def inner(*args, **kwds): 2837s with self._recreate_cm(): 2837s > return func(*args, **kwds) 2837s 2837s /usr/lib/python3.13/contextlib.py:85: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3.13/contextlib.py:85: in inner 2837s return func(*args, **kwds) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 2837s return _run_and_close_tornado(async_fn_outer) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 2837s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 2837s /usr/lib/python3.13/asyncio/runners.py:194: in run 2837s return runner.run(main) 2837s /usr/lib/python3.13/asyncio/runners.py:118: in run 2837s return self._loop.run_until_complete(task) 2837s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 2837s return future.result() 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 2837s return await async_fn(*args, **kwargs) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 2837s return await utils_wait_for(async_fn(), timeout=timeout * 2) 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s ----------------------------- Captured stderr call ----------------------------- 2837s 2024-11-24 00:54:33,335 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:33,339 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42593 2837s 2024-11-24 00:54:33,340 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43881/status 2837s 2024-11-24 00:54:33,340 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:33,357 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40979'. Reason: failure-to-start- 2837s 2024-11-24 00:54:33,357 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40489'. Reason: failure-to-start- 2837s 2024-11-24 00:54:33,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42593': TLS handshake failed with remote 'tls://127.0.0.1:57750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:33,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42593': TLS handshake failed with remote 'tls://127.0.0.1:57766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:33,358 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:34,363 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:34,367 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32907 2837s 2024-11-24 00:54:34,367 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46067/status 2837s 2024-11-24 00:54:34,367 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:34,386 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37775'. Reason: failure-to-start- 2837s 2024-11-24 00:54:34,386 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44781'. Reason: failure-to-start- 2837s 2024-11-24 00:54:34,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32907': TLS handshake failed with remote 'tls://127.0.0.1:56088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:34,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32907': TLS handshake failed with remote 'tls://127.0.0.1:56100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:34,387 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:35,391 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:35,395 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44973 2837s 2024-11-24 00:54:35,395 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37345/status 2837s 2024-11-24 00:54:35,395 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:35,413 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32847'. Reason: failure-to-start- 2837s 2024-11-24 00:54:35,413 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37985'. Reason: failure-to-start- 2837s 2024-11-24 00:54:35,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44973': TLS handshake failed with remote 'tls://127.0.0.1:43018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:35,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44973': TLS handshake failed with remote 'tls://127.0.0.1:43028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:35,414 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:36,419 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:36,423 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42039 2837s 2024-11-24 00:54:36,423 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42761/status 2837s 2024-11-24 00:54:36,423 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:36,442 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39829'. Reason: failure-to-start- 2837s 2024-11-24 00:54:36,442 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43613'. Reason: failure-to-start- 2837s 2024-11-24 00:54:36,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42039': TLS handshake failed with remote 'tls://127.0.0.1:52094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:36,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42039': TLS handshake failed with remote 'tls://127.0.0.1:52096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:36,443 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:37,448 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:37,452 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43177 2837s 2024-11-24 00:54:37,452 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35145/status 2837s 2024-11-24 00:54:37,452 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:37,470 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34273'. Reason: failure-to-start- 2837s 2024-11-24 00:54:37,470 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39921'. Reason: failure-to-start- 2837s 2024-11-24 00:54:37,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43177': TLS handshake failed with remote 'tls://127.0.0.1:59068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:37,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43177': TLS handshake failed with remote 'tls://127.0.0.1:59072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:37,471 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:38,475 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:38,480 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41305 2837s 2024-11-24 00:54:38,480 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44555/status 2837s 2024-11-24 00:54:38,480 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:38,499 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46837'. Reason: failure-to-start- 2837s 2024-11-24 00:54:38,499 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39685'. Reason: failure-to-start- 2837s 2024-11-24 00:54:38,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41305': TLS handshake failed with remote 'tls://127.0.0.1:45458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:38,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41305': TLS handshake failed with remote 'tls://127.0.0.1:45460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:38,500 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:39,505 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:39,509 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33755 2837s 2024-11-24 00:54:39,509 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39795/status 2837s 2024-11-24 00:54:39,509 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:39,526 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35519'. Reason: failure-to-start- 2837s 2024-11-24 00:54:39,527 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35855'. Reason: failure-to-start- 2837s 2024-11-24 00:54:39,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33755': TLS handshake failed with remote 'tls://127.0.0.1:43156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:39,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33755': TLS handshake failed with remote 'tls://127.0.0.1:43164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:39,527 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:40,532 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:40,536 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46163 2837s 2024-11-24 00:54:40,536 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34009/status 2837s 2024-11-24 00:54:40,537 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:40,555 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44645'. Reason: failure-to-start- 2837s 2024-11-24 00:54:40,556 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35913'. Reason: failure-to-start- 2837s 2024-11-24 00:54:40,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46163': TLS handshake failed with remote 'tls://127.0.0.1:46290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:40,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46163': TLS handshake failed with remote 'tls://127.0.0.1:46302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:40,556 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:41,561 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:41,566 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36195 2837s 2024-11-24 00:54:41,566 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34893/status 2837s 2024-11-24 00:54:41,566 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:41,584 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40499'. Reason: failure-to-start- 2837s 2024-11-24 00:54:41,584 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41177'. Reason: failure-to-start- 2837s 2024-11-24 00:54:41,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36195': TLS handshake failed with remote 'tls://127.0.0.1:39658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:41,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36195': TLS handshake failed with remote 'tls://127.0.0.1:39672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:41,585 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:42,589 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:42,593 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41255 2837s 2024-11-24 00:54:42,594 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37617/status 2837s 2024-11-24 00:54:42,594 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:42,612 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38489'. Reason: failure-to-start- 2837s 2024-11-24 00:54:42,612 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42407'. Reason: failure-to-start- 2837s 2024-11-24 00:54:42,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41255': TLS handshake failed with remote 'tls://127.0.0.1:34360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:42,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41255': TLS handshake failed with remote 'tls://127.0.0.1:34376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:42,613 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:43,617 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:43,622 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33627 2837s 2024-11-24 00:54:43,622 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46513/status 2837s 2024-11-24 00:54:43,622 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:43,640 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46249'. Reason: failure-to-start- 2837s 2024-11-24 00:54:43,640 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40215'. Reason: failure-to-start- 2837s 2024-11-24 00:54:43,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33627': TLS handshake failed with remote 'tls://127.0.0.1:36814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:43,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33627': TLS handshake failed with remote 'tls://127.0.0.1:36816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:43,641 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:44,645 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:44,649 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46609 2837s 2024-11-24 00:54:44,649 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43261/status 2837s 2024-11-24 00:54:44,649 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:44,667 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39327'. Reason: failure-to-start- 2837s 2024-11-24 00:54:44,667 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40807'. Reason: failure-to-start- 2837s 2024-11-24 00:54:44,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46609': TLS handshake failed with remote 'tls://127.0.0.1:55778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:44,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46609': TLS handshake failed with remote 'tls://127.0.0.1:55794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:44,667 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:45,672 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:45,676 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38701 2837s 2024-11-24 00:54:45,677 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37753/status 2837s 2024-11-24 00:54:45,677 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:45,694 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38473'. Reason: failure-to-start- 2837s 2024-11-24 00:54:45,694 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44069'. Reason: failure-to-start- 2837s 2024-11-24 00:54:45,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38701': TLS handshake failed with remote 'tls://127.0.0.1:55564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:45,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38701': TLS handshake failed with remote 'tls://127.0.0.1:55578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:45,695 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:46,699 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:46,703 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36335 2837s 2024-11-24 00:54:46,704 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35633/status 2837s 2024-11-24 00:54:46,704 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:46,722 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44755'. Reason: failure-to-start- 2837s 2024-11-24 00:54:46,722 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39141'. Reason: failure-to-start- 2837s 2024-11-24 00:54:46,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36335': TLS handshake failed with remote 'tls://127.0.0.1:41342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:46,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36335': TLS handshake failed with remote 'tls://127.0.0.1:41358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:46,722 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:47,727 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:47,731 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42149 2837s 2024-11-24 00:54:47,731 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37057/status 2837s 2024-11-24 00:54:47,731 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:47,748 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45747'. Reason: failure-to-start- 2837s 2024-11-24 00:54:47,748 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39733'. Reason: failure-to-start- 2837s 2024-11-24 00:54:47,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42149': TLS handshake failed with remote 'tls://127.0.0.1:60368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:47,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42149': TLS handshake failed with remote 'tls://127.0.0.1:60372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:47,749 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:48,753 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:48,757 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43463 2837s 2024-11-24 00:54:48,757 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42185/status 2837s 2024-11-24 00:54:48,757 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:48,775 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39307'. Reason: failure-to-start- 2837s 2024-11-24 00:54:48,776 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34287'. Reason: failure-to-start- 2837s 2024-11-24 00:54:48,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43463': TLS handshake failed with remote 'tls://127.0.0.1:43444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:48,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43463': TLS handshake failed with remote 'tls://127.0.0.1:43456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:48,776 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:49,780 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:49,784 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45201 2837s 2024-11-24 00:54:49,784 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32967/status 2837s 2024-11-24 00:54:49,784 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:49,801 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39719'. Reason: failure-to-start- 2837s 2024-11-24 00:54:49,801 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38255'. Reason: failure-to-start- 2837s 2024-11-24 00:54:49,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45201': TLS handshake failed with remote 'tls://127.0.0.1:42954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:49,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45201': TLS handshake failed with remote 'tls://127.0.0.1:42962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:49,802 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:50,806 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:50,812 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37147 2837s 2024-11-24 00:54:50,812 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43961/status 2837s 2024-11-24 00:54:50,812 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:50,830 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43867'. Reason: failure-to-start- 2837s 2024-11-24 00:54:50,830 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43103'. Reason: failure-to-start- 2837s 2024-11-24 00:54:50,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37147': TLS handshake failed with remote 'tls://127.0.0.1:48192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:50,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37147': TLS handshake failed with remote 'tls://127.0.0.1:48198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:50,831 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:51,835 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:51,839 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44617 2837s 2024-11-24 00:54:51,840 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44691/status 2837s 2024-11-24 00:54:51,840 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:51,857 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45801'. Reason: failure-to-start- 2837s 2024-11-24 00:54:51,858 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39319'. Reason: failure-to-start- 2837s 2024-11-24 00:54:51,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44617': TLS handshake failed with remote 'tls://127.0.0.1:51464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:51,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44617': TLS handshake failed with remote 'tls://127.0.0.1:51478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:51,858 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:52,862 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:52,868 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41703 2837s 2024-11-24 00:54:52,868 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41137/status 2837s 2024-11-24 00:54:52,868 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:52,886 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38999'. Reason: failure-to-start- 2837s 2024-11-24 00:54:52,886 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39709'. Reason: failure-to-start- 2837s 2024-11-24 00:54:52,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41703': TLS handshake failed with remote 'tls://127.0.0.1:44006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:52,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41703': TLS handshake failed with remote 'tls://127.0.0.1:44018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:52,887 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:53,891 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:53,895 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46213 2837s 2024-11-24 00:54:53,896 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37803/status 2837s 2024-11-24 00:54:53,896 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:53,915 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36285'. Reason: failure-to-start- 2837s 2024-11-24 00:54:53,916 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38651'. Reason: failure-to-start- 2837s 2024-11-24 00:54:53,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46213': TLS handshake failed with remote 'tls://127.0.0.1:50374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:53,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46213': TLS handshake failed with remote 'tls://127.0.0.1:50378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:53,916 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:54,922 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:54,926 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46439 2837s 2024-11-24 00:54:54,926 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43367/status 2837s 2024-11-24 00:54:54,927 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:54,945 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43263'. Reason: failure-to-start- 2837s 2024-11-24 00:54:54,945 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44601'. Reason: failure-to-start- 2837s 2024-11-24 00:54:54,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46439': TLS handshake failed with remote 'tls://127.0.0.1:60304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:54,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46439': TLS handshake failed with remote 'tls://127.0.0.1:60318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:54,946 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:55,951 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:55,955 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38437 2837s 2024-11-24 00:54:55,955 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41329/status 2837s 2024-11-24 00:54:55,955 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:55,973 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34405'. Reason: failure-to-start- 2837s 2024-11-24 00:54:55,973 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39483'. Reason: failure-to-start- 2837s 2024-11-24 00:54:55,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38437': TLS handshake failed with remote 'tls://127.0.0.1:49436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:55,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38437': TLS handshake failed with remote 'tls://127.0.0.1:49444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:55,973 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:56,978 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:56,982 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43269 2837s 2024-11-24 00:54:56,982 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46685/status 2837s 2024-11-24 00:54:56,982 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:57,001 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45111'. Reason: failure-to-start- 2837s 2024-11-24 00:54:57,001 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39789'. Reason: failure-to-start- 2837s 2024-11-24 00:54:57,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43269': TLS handshake failed with remote 'tls://127.0.0.1:57220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:57,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43269': TLS handshake failed with remote 'tls://127.0.0.1:57230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:57,002 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:58,006 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:58,011 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43879 2837s 2024-11-24 00:54:58,011 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40297/status 2837s 2024-11-24 00:54:58,011 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:58,043 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40673'. Reason: failure-to-start- 2837s 2024-11-24 00:54:58,043 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45889'. Reason: failure-to-start- 2837s 2024-11-24 00:54:58,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43879': TLS handshake failed with remote 'tls://127.0.0.1:36514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:58,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43879': TLS handshake failed with remote 'tls://127.0.0.1:36518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:58,045 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:54:59,052 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:54:59,064 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40233 2837s 2024-11-24 00:54:59,065 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35925/status 2837s 2024-11-24 00:54:59,065 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:54:59,107 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38773'. Reason: failure-to-start- 2837s 2024-11-24 00:54:59,107 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33249'. Reason: failure-to-start- 2837s 2024-11-24 00:54:59,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40233': TLS handshake failed with remote 'tls://127.0.0.1:34154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:59,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40233': TLS handshake failed with remote 'tls://127.0.0.1:34162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:54:59,112 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:55:00,119 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:00,124 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38817 2837s 2024-11-24 00:55:00,124 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35411/status 2837s 2024-11-24 00:55:00,124 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:00,146 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36513'. Reason: failure-to-start- 2837s 2024-11-24 00:55:00,146 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33559'. Reason: failure-to-start- 2837s 2024-11-24 00:55:00,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38817': TLS handshake failed with remote 'tls://127.0.0.1:58488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:00,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38817': TLS handshake failed with remote 'tls://127.0.0.1:58492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:00,147 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:55:01,151 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:01,155 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46711 2837s 2024-11-24 00:55:01,156 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37367/status 2837s 2024-11-24 00:55:01,157 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:01,174 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38013'. Reason: failure-to-start- 2837s 2024-11-24 00:55:01,175 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38155'. Reason: failure-to-start- 2837s 2024-11-24 00:55:01,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46711': TLS handshake failed with remote 'tls://127.0.0.1:54432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:01,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46711': TLS handshake failed with remote 'tls://127.0.0.1:54438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:01,175 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:55:02,180 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:02,184 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38913 2837s 2024-11-24 00:55:02,184 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41073/status 2837s 2024-11-24 00:55:02,184 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:02,203 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43639'. Reason: failure-to-start- 2837s 2024-11-24 00:55:02,203 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42747'. Reason: failure-to-start- 2837s 2024-11-24 00:55:02,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38913': TLS handshake failed with remote 'tls://127.0.0.1:38656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:02,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38913': TLS handshake failed with remote 'tls://127.0.0.1:38672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:02,204 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 2837s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 2837s RuntimeError: Nanny failed to start. 2837s 2024-11-24 00:55:03,209 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:03,213 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41037 2837s 2024-11-24 00:55:03,213 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38779/status 2837s 2024-11-24 00:55:03,214 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:03,221 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34797'. Reason: failure-to-start- 2837s 2024-11-24 00:55:03,221 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34997'. Reason: failure-to-start- 2837s 2024-11-24 00:55:03,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41037': TLS handshake failed with remote 'tls://127.0.0.1:41546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:03,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41037': TLS handshake failed with remote 'tls://127.0.0.1:41552': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:03,222 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:04,227 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:04,231 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46735 2837s 2024-11-24 00:55:04,231 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33663/status 2837s 2024-11-24 00:55:04,231 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:04,241 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42919'. Reason: failure-to-start- 2837s 2024-11-24 00:55:04,242 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34481'. Reason: failure-to-start- 2837s 2024-11-24 00:55:04,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46735': TLS handshake failed with remote 'tls://127.0.0.1:53752': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:04,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46735': TLS handshake failed with remote 'tls://127.0.0.1:53766': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:04,242 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:05,246 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:05,250 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36141 2837s 2024-11-24 00:55:05,251 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38987/status 2837s 2024-11-24 00:55:05,251 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:05,258 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34517'. Reason: failure-to-start- 2837s 2024-11-24 00:55:05,258 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35077'. Reason: failure-to-start- 2837s 2024-11-24 00:55:05,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36141': TLS handshake failed with remote 'tls://127.0.0.1:50002': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:05,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36141': TLS handshake failed with remote 'tls://127.0.0.1:50012': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:05,260 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:06,264 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:06,270 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41515 2837s 2024-11-24 00:55:06,270 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33425/status 2837s 2024-11-24 00:55:06,271 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:06,278 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35267'. Reason: failure-to-start- 2837s 2024-11-24 00:55:06,278 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40583'. Reason: failure-to-start- 2837s 2024-11-24 00:55:06,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41515': TLS handshake failed with remote 'tls://127.0.0.1:53080': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:06,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41515': TLS handshake failed with remote 'tls://127.0.0.1:53094': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:06,279 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:07,283 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:07,287 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33551 2837s 2024-11-24 00:55:07,288 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39099/status 2837s 2024-11-24 00:55:07,288 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:07,296 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39427'. Reason: failure-to-start- 2837s 2024-11-24 00:55:07,296 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39245'. Reason: failure-to-start- 2837s 2024-11-24 00:55:07,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33551': TLS handshake failed with remote 'tls://127.0.0.1:34642': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:07,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33551': TLS handshake failed with remote 'tls://127.0.0.1:34652': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:07,297 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:08,303 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:08,308 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43731 2837s 2024-11-24 00:55:08,308 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41877/status 2837s 2024-11-24 00:55:08,308 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:08,317 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39823'. Reason: failure-to-start- 2837s 2024-11-24 00:55:08,317 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35787'. Reason: failure-to-start- 2837s 2024-11-24 00:55:08,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43731': TLS handshake failed with remote 'tls://127.0.0.1:57836': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:08,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43731': TLS handshake failed with remote 'tls://127.0.0.1:57848': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:08,318 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:09,323 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:09,327 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34555 2837s 2024-11-24 00:55:09,328 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33463/status 2837s 2024-11-24 00:55:09,328 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:09,336 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42085'. Reason: failure-to-start- 2837s 2024-11-24 00:55:09,337 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44877'. Reason: failure-to-start- 2837s 2024-11-24 00:55:09,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34555': TLS handshake failed with remote 'tls://127.0.0.1:37096': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:09,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34555': TLS handshake failed with remote 'tls://127.0.0.1:37100': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:09,337 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:10,342 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:10,346 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40743 2837s 2024-11-24 00:55:10,347 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42529/status 2837s 2024-11-24 00:55:10,348 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:10,357 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41657'. Reason: failure-to-start- 2837s 2024-11-24 00:55:10,357 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41623'. Reason: failure-to-start- 2837s 2024-11-24 00:55:10,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40743': TLS handshake failed with remote 'tls://127.0.0.1:46630': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:10,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40743': TLS handshake failed with remote 'tls://127.0.0.1:46638': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:10,358 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:11,362 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:11,366 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38279 2837s 2024-11-24 00:55:11,366 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39501/status 2837s 2024-11-24 00:55:11,367 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:11,378 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35731'. Reason: failure-to-start- 2837s 2024-11-24 00:55:11,378 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41257'. Reason: failure-to-start- 2837s 2024-11-24 00:55:11,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38279': TLS handshake failed with remote 'tls://127.0.0.1:34806': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:11,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38279': TLS handshake failed with remote 'tls://127.0.0.1:34818': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:11,379 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:12,383 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:12,388 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40071 2837s 2024-11-24 00:55:12,388 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33331/status 2837s 2024-11-24 00:55:12,388 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:12,396 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38517'. Reason: failure-to-start- 2837s 2024-11-24 00:55:12,397 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43975'. Reason: failure-to-start- 2837s 2024-11-24 00:55:12,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40071': TLS handshake failed with remote 'tls://127.0.0.1:56902': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:12,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40071': TLS handshake failed with remote 'tls://127.0.0.1:56906': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:12,398 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:13,403 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:13,407 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37059 2837s 2024-11-24 00:55:13,408 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40485/status 2837s 2024-11-24 00:55:13,408 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:13,418 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38407'. Reason: failure-to-start- 2837s 2024-11-24 00:55:13,418 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33327'. Reason: failure-to-start- 2837s 2024-11-24 00:55:13,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37059': TLS handshake failed with remote 'tls://127.0.0.1:58838': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:13,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37059': TLS handshake failed with remote 'tls://127.0.0.1:58848': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:13,419 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:14,424 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:14,428 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43735 2837s 2024-11-24 00:55:14,428 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44027/status 2837s 2024-11-24 00:55:14,429 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:14,439 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35269'. Reason: failure-to-start- 2837s 2024-11-24 00:55:14,439 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41279'. Reason: failure-to-start- 2837s 2024-11-24 00:55:14,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43735': TLS handshake failed with remote 'tls://127.0.0.1:57090': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:14,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43735': TLS handshake failed with remote 'tls://127.0.0.1:57096': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:14,440 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:15,444 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:15,450 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44743 2837s 2024-11-24 00:55:15,450 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43957/status 2837s 2024-11-24 00:55:15,451 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:15,460 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33583'. Reason: failure-to-start- 2837s 2024-11-24 00:55:15,460 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40583'. Reason: failure-to-start- 2837s 2024-11-24 00:55:15,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44743': TLS handshake failed with remote 'tls://127.0.0.1:49264': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:15,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44743': TLS handshake failed with remote 'tls://127.0.0.1:49268': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:15,462 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:16,466 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:16,470 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44041 2837s 2024-11-24 00:55:16,471 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36239/status 2837s 2024-11-24 00:55:16,471 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:16,478 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45045'. Reason: failure-to-start- 2837s 2024-11-24 00:55:16,478 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34595'. Reason: failure-to-start- 2837s 2024-11-24 00:55:16,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44041': TLS handshake failed with remote 'tls://127.0.0.1:50284': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:16,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44041': TLS handshake failed with remote 'tls://127.0.0.1:50300': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:16,479 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:17,484 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:17,489 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41379 2837s 2024-11-24 00:55:17,490 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32965/status 2837s 2024-11-24 00:55:17,490 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:17,499 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42913'. Reason: failure-to-start- 2837s 2024-11-24 00:55:17,499 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40339'. Reason: failure-to-start- 2837s 2024-11-24 00:55:17,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41379': TLS handshake failed with remote 'tls://127.0.0.1:54190': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:17,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41379': TLS handshake failed with remote 'tls://127.0.0.1:54198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:17,499 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:18,504 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:18,509 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43023 2837s 2024-11-24 00:55:18,509 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34407/status 2837s 2024-11-24 00:55:18,509 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:18,518 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45349'. Reason: failure-to-start- 2837s 2024-11-24 00:55:18,519 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32781'. Reason: failure-to-start- 2837s 2024-11-24 00:55:18,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43023': TLS handshake failed with remote 'tls://127.0.0.1:41010': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:18,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43023': TLS handshake failed with remote 'tls://127.0.0.1:41018': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:18,519 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:19,524 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:19,530 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43033 2837s 2024-11-24 00:55:19,530 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37911/status 2837s 2024-11-24 00:55:19,530 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:19,538 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45603'. Reason: failure-to-start- 2837s 2024-11-24 00:55:19,538 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35165'. Reason: failure-to-start- 2837s 2024-11-24 00:55:19,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43033': TLS handshake failed with remote 'tls://127.0.0.1:38010': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:19,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43033': TLS handshake failed with remote 'tls://127.0.0.1:38016': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:19,539 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:20,544 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:20,548 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41265 2837s 2024-11-24 00:55:20,548 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33823/status 2837s 2024-11-24 00:55:20,548 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:20,555 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37901'. Reason: failure-to-start- 2837s 2024-11-24 00:55:20,555 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34385'. Reason: failure-to-start- 2837s 2024-11-24 00:55:20,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41265': TLS handshake failed with remote 'tls://127.0.0.1:39780': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:20,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41265': TLS handshake failed with remote 'tls://127.0.0.1:39790': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:20,556 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:21,560 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:21,575 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42653 2837s 2024-11-24 00:55:21,576 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44951/status 2837s 2024-11-24 00:55:21,576 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:21,586 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39087'. Reason: failure-to-start- 2837s 2024-11-24 00:55:21,586 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36119'. Reason: failure-to-start- 2837s 2024-11-24 00:55:21,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42653': TLS handshake failed with remote 'tls://127.0.0.1:36640': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:21,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42653': TLS handshake failed with remote 'tls://127.0.0.1:36656': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:21,587 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:22,591 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:22,596 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42183 2837s 2024-11-24 00:55:22,596 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36931/status 2837s 2024-11-24 00:55:22,596 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:22,605 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33129'. Reason: failure-to-start- 2837s 2024-11-24 00:55:22,606 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35483'. Reason: failure-to-start- 2837s 2024-11-24 00:55:22,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42183': TLS handshake failed with remote 'tls://127.0.0.1:44828': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:22,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42183': TLS handshake failed with remote 'tls://127.0.0.1:44840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:22,606 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:23,611 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:23,618 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46549 2837s 2024-11-24 00:55:23,618 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40221/status 2837s 2024-11-24 00:55:23,618 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:23,627 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37729'. Reason: failure-to-start- 2837s 2024-11-24 00:55:23,627 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45693'. Reason: failure-to-start- 2837s 2024-11-24 00:55:23,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46549': TLS handshake failed with remote 'tls://127.0.0.1:47578': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:23,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46549': TLS handshake failed with remote 'tls://127.0.0.1:47582': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:23,629 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:24,633 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:24,637 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34037 2837s 2024-11-24 00:55:24,638 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37539/status 2837s 2024-11-24 00:55:24,638 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:24,645 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40219'. Reason: failure-to-start- 2837s 2024-11-24 00:55:24,645 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41639'. Reason: failure-to-start- 2837s 2024-11-24 00:55:24,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34037': TLS handshake failed with remote 'tls://127.0.0.1:38822': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:24,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34037': TLS handshake failed with remote 'tls://127.0.0.1:38834': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:24,646 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:25,650 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:25,656 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45483 2837s 2024-11-24 00:55:25,657 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44865/status 2837s 2024-11-24 00:55:25,657 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:25,666 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45783'. Reason: failure-to-start- 2837s 2024-11-24 00:55:25,666 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37521'. Reason: failure-to-start- 2837s 2024-11-24 00:55:25,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45483': TLS handshake failed with remote 'tls://127.0.0.1:36038': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:25,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45483': TLS handshake failed with remote 'tls://127.0.0.1:36054': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:25,667 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:26,671 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:26,675 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39817 2837s 2024-11-24 00:55:26,676 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46185/status 2837s 2024-11-24 00:55:26,676 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:26,685 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44843'. Reason: failure-to-start- 2837s 2024-11-24 00:55:26,685 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44741'. Reason: failure-to-start- 2837s 2024-11-24 00:55:26,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39817': TLS handshake failed with remote 'tls://127.0.0.1:57300': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:26,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39817': TLS handshake failed with remote 'tls://127.0.0.1:57312': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:26,687 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:27,692 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:27,698 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46371 2837s 2024-11-24 00:55:27,699 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40617/status 2837s 2024-11-24 00:55:27,699 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:27,708 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46649'. Reason: failure-to-start- 2837s 2024-11-24 00:55:27,709 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40993'. Reason: failure-to-start- 2837s 2024-11-24 00:55:27,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46371': TLS handshake failed with remote 'tls://127.0.0.1:49472': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:27,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46371': TLS handshake failed with remote 'tls://127.0.0.1:49488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:27,709 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:28,714 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:28,719 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35333 2837s 2024-11-24 00:55:28,719 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44463/status 2837s 2024-11-24 00:55:28,719 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:28,727 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33733'. Reason: failure-to-start- 2837s 2024-11-24 00:55:28,727 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35269'. Reason: failure-to-start- 2837s 2024-11-24 00:55:28,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35333': TLS handshake failed with remote 'tls://127.0.0.1:57744': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:28,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35333': TLS handshake failed with remote 'tls://127.0.0.1:57756': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:28,728 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:29,733 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:29,739 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34577 2837s 2024-11-24 00:55:29,739 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38953/status 2837s 2024-11-24 00:55:29,740 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:29,749 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44247'. Reason: failure-to-start- 2837s 2024-11-24 00:55:29,749 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44367'. Reason: failure-to-start- 2837s 2024-11-24 00:55:29,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34577': TLS handshake failed with remote 'tls://127.0.0.1:59470': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:29,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34577': TLS handshake failed with remote 'tls://127.0.0.1:59484': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:29,750 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:30,754 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:30,758 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40811 2837s 2024-11-24 00:55:30,759 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33469/status 2837s 2024-11-24 00:55:30,759 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:30,767 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45407'. Reason: failure-to-start- 2837s 2024-11-24 00:55:30,767 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43647'. Reason: failure-to-start- 2837s 2024-11-24 00:55:30,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40811': TLS handshake failed with remote 'tls://127.0.0.1:36044': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:30,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40811': TLS handshake failed with remote 'tls://127.0.0.1:36046': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:30,768 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:31,772 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:31,778 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38429 2837s 2024-11-24 00:55:31,779 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38217/status 2837s 2024-11-24 00:55:31,779 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:31,789 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36539'. Reason: failure-to-start- 2837s 2024-11-24 00:55:31,789 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45301'. Reason: failure-to-start- 2837s 2024-11-24 00:55:31,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38429': TLS handshake failed with remote 'tls://127.0.0.1:54024': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:31,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38429': TLS handshake failed with remote 'tls://127.0.0.1:54038': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:31,790 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s 2024-11-24 00:55:32,793 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:32,798 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41461 2837s 2024-11-24 00:55:32,798 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33545/status 2837s 2024-11-24 00:55:32,798 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:32,805 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41575'. Reason: failure-to-start- 2837s 2024-11-24 00:55:32,805 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34287'. Reason: failure-to-start- 2837s 2024-11-24 00:55:32,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41461': TLS handshake failed with remote 'tls://127.0.0.1:47894': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:32,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41461': TLS handshake failed with remote 'tls://127.0.0.1:47902': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:55:32,806 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2837s comm = await self.rpc.connect(saddr) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 2837s return await self._connect(addr=addr, timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 2837s comm = await connect( 2837s ^^^^^^^^^^^^^^ 2837s ...<4 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Nanny start timed out after 0s. 2837s ___________________________ test_security_dict_input ___________________________ 2837s 2837s @gen_test() 2837s async def test_security_dict_input(): 2837s conf = tls_config() 2837s ca_file = conf["distributed"]["comm"]["tls"]["ca-file"] 2837s client = conf["distributed"]["comm"]["tls"]["client"]["cert"] 2837s worker = conf["distributed"]["comm"]["tls"]["worker"]["cert"] 2837s scheduler = conf["distributed"]["comm"]["tls"]["scheduler"]["cert"] 2837s 2837s async with Scheduler( 2837s host="localhost", 2837s dashboard_address=":0", 2837s security={"tls_ca_file": ca_file, "tls_scheduler_cert": scheduler}, 2837s ) as s: 2837s assert s.address.startswith("tls://") 2837s > async with Worker( 2837s s.address, security={"tls_ca_file": ca_file, "tls_worker_cert": worker} 2837s ) as w: 2837s 2837s /usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py:225: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/core.py:678: in __aenter__ 2837s await self 2837s /usr/lib/python3/dist-packages/distributed/core.py:664: in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2837s return await fut 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 2837s await self._register_with_scheduler() 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2837s comm = await wait_for( 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2837s return await fut 2837s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 2837s stream = await self.client.connect( 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s host = '127.0.0.1', port = 35371, af = 2837s ssl_options = 2837s max_buffer_size = 4151066624.0, source_ip = None, source_port = None 2837s timeout = None 2837s 2837s async def connect( 2837s self, 2837s host: str, 2837s port: int, 2837s af: socket.AddressFamily = socket.AF_UNSPEC, 2837s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 2837s max_buffer_size: Optional[int] = None, 2837s source_ip: Optional[str] = None, 2837s source_port: Optional[int] = None, 2837s timeout: Optional[Union[float, datetime.timedelta]] = None, 2837s ) -> IOStream: 2837s """Connect to the given host and port. 2837s 2837s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 2837s ``ssl_options`` is not None). 2837s 2837s Using the ``source_ip`` kwarg, one can specify the source 2837s IP address to use when establishing the connection. 2837s In case the user needs to resolve and 2837s use a specific interface, it has to be handled outside 2837s of Tornado as this depends very much on the platform. 2837s 2837s Raises `TimeoutError` if the input future does not complete before 2837s ``timeout``, which may be specified in any form allowed by 2837s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 2837s relative to `.IOLoop.time`) 2837s 2837s Similarly, when the user requires a certain source port, it can 2837s be specified using the ``source_port`` arg. 2837s 2837s .. versionchanged:: 4.5 2837s Added the ``source_ip`` and ``source_port`` arguments. 2837s 2837s .. versionchanged:: 5.0 2837s Added the ``timeout`` argument. 2837s """ 2837s if timeout is not None: 2837s if isinstance(timeout, numbers.Real): 2837s timeout = IOLoop.current().time() + timeout 2837s elif isinstance(timeout, datetime.timedelta): 2837s timeout = IOLoop.current().time() + timeout.total_seconds() 2837s else: 2837s raise TypeError("Unsupported timeout %r" % timeout) 2837s if timeout is not None: 2837s addrinfo = await gen.with_timeout( 2837s timeout, self.resolver.resolve(host, port, af) 2837s ) 2837s else: 2837s addrinfo = await self.resolver.resolve(host, port, af) 2837s connector = _Connector( 2837s addrinfo, 2837s functools.partial( 2837s self._create_stream, 2837s max_buffer_size, 2837s source_ip=source_ip, 2837s source_port=source_port, 2837s ), 2837s ) 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s # TODO: For better performance we could cache the (af, addr) 2837s # information here and re-use it on subsequent connections to 2837s # the same host. (http://tools.ietf.org/html/rfc6555#section-4.2) 2837s if ssl_options is not None: 2837s if timeout is not None: 2837s stream = await gen.with_timeout( 2837s timeout, 2837s stream.start_tls( 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ), 2837s ) 2837s else: 2837s > stream = await stream.start_tls( 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ) 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s args = (), kwds = {} 2837s 2837s @wraps(func) 2837s def inner(*args, **kwds): 2837s with self._recreate_cm(): 2837s > return func(*args, **kwds) 2837s 2837s /usr/lib/python3.13/contextlib.py:85: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3.13/contextlib.py:85: in inner 2837s return func(*args, **kwds) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:746: in test_func 2837s return _run_and_close_tornado(async_fn_outer, func, *args, **kwargs) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 2837s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 2837s /usr/lib/python3.13/asyncio/runners.py:194: in run 2837s return runner.run(main) 2837s /usr/lib/python3.13/asyncio/runners.py:118: in run 2837s return self._loop.run_until_complete(task) 2837s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 2837s return future.result() 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 2837s return await async_fn(*args, **kwargs) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:736: in async_fn_outer 2837s return await utils_wait_for(async_fn(*args, **kwargs), timeout) 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s ----------------------------- Captured stderr call ----------------------------- 2837s 2024-11-24 00:55:33,832 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:55:33,837 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:33,837 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40487/status 2837s 2024-11-24 00:55:33,837 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:55:33,843 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42599 2837s 2024-11-24 00:55:33,843 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42599 2837s 2024-11-24 00:55:33,843 - distributed.worker - INFO - dashboard at: 127.0.0.1:46749 2837s 2024-11-24 00:55:33,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:33,843 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:55:33,843 - distributed.worker - INFO - Threads: 4 2837s 2024-11-24 00:55:33,843 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:55:33,843 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-icztegaa 2837s 2024-11-24 00:55:33,843 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:55:33,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:33,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:41492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:33,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:33,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:41498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:34,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:34,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:41514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:34,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:34,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:41522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:34,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:34,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:41538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:34,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:34,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:41546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:34,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:34,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:41552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:34,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:34,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:41554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:34,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:34,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:41560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:34,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:34,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:41576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:34,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:34,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:41584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:35,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:35,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:41592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:35,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:35,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:41604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:35,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:35,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:41620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:35,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:35,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:35,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:35,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:35,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:35,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:35,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:35,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:35,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:35,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:35,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:35,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:35,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:35,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:36,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:36,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:36,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:36,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:36,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:36,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:36,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:36,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:36,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:36,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:36,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:36,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:36,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:36,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:36,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:36,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:36,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:36,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:37,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:37,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:37,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:37,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:37,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:37,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:37,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:37,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:37,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:37,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:37,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:37,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:37,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:37,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:37,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:37,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:37,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:37,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:38,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:38,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:38,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:38,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:38,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:38,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:38,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:38,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:38,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:38,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:38,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:38,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:38,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:38,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:38,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:38,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:38,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:38,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:38,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:38,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:39,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:39,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:39,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:39,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:39,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:39,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:39,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:39,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:39,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:39,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:39,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:39,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:39,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:39,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:39,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:39,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:39,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:39,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:40,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:40,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:40,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:40,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:40,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:40,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:40,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:40,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:40,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:40,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:54986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:40,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:40,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:40,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:40,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:40,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:40,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:40,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:40,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:40,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:40,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:41,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:41,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:41,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:41,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:41,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:41,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:41,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:41,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:41,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:41,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:41,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:41,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:41,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:41,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:41,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:41,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:41,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:41,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:42,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:42,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:42,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:42,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:42,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:42,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:42,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:42,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:42,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:42,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:42,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:42,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:42,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:42,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:42,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:42,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:42,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:42,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:43,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:43,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:43,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:43,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:43,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:43,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:43,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:43,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:43,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:43,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:43,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:43,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:43,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:43,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:43,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:43,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:43,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:43,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:43,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:43,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:44,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:44,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:44,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:44,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:44,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:44,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:44,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:44,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:44,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:44,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:44,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:44,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:44,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:44,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:44,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:44,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:44,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:44,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:45,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:45,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:45,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:45,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:55376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:45,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:45,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:45,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:45,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:45,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:45,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:45,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:45,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:45,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:45,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:45,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:45,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:45,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:45,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:46,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:46,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:46,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:46,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:46,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:46,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:46,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:46,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:46,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:46,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:46,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:46,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:46,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:46,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:46,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:46,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:46,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:46,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:46,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:46,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:47,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:47,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:47,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:47,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:47,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:47,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:47,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:47,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:47,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:47,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:47,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:47,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:47,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:47,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:47,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:47,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:47,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:47,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:48,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:48,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:48,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:48,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:48,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:48,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:48,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:48,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:48,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:48,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:48,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:48,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:48,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:48,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:48,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:48,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:48,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:48,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:48,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:48,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:49,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:49,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:49,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:49,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:49,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:49,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:49,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:49,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:49,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:49,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:49,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:49,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:49,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:49,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:49,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:49,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:49,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:49,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:50,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:50,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:50,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:50,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:50,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:50,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:50,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:50,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:50,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:50,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:50,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:50,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:50,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:50,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:50,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:50,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:50,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:50,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:51,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:51,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:51990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:51,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:51,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:51,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:51,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:51,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:51,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:51,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:51,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:51,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:51,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:51,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:51,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:51,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:51,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:51,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:51,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:51,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:51,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:52,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:52,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:52,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:52,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:52,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:52,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:52,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:52,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:52,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:52,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:52,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:52,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:52,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:52,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:52,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:52,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:52,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:52,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:53,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:53,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:53,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:53,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:53,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:53,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:53,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:53,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:53,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:53,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:53,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:53,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:53,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:53,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:53,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:53,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:53,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:53,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:53,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:53,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:54,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:54,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:54,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:54,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:54,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:54,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:54,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:54,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:54,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:54,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:54,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:54,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:54,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:54,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:54,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:54,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:54,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:54,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:55,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:55,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:55,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:55,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:52394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:55,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:55,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:55,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:55,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:55,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:55,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:55,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:55,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:55,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:55,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:55,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:55,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:55,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:55,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:56,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:56,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:56,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:56,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:56,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:56,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:56,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:56,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:56,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:56,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:56,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:56,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:56,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:56,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:56,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:56,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:56,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:56,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:56,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:56,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:57,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:57,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:57,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:57,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:57,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:57,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:57,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:57,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:57,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:57,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:57,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:57,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:57,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:57,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:57,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:57,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:57,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:57,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:58,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:58,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:58,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:58,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:58,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:58,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:58,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:58,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:58,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:58,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:58,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:58,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:58,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:58,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:58,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:58,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:58,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:58,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:59,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:59,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:59,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:59,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:59,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:59,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:59,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:59,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:59,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:59,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:59,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:59,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:59,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:59,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:59,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:59,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:59,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:59,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:55:59,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:55:59,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:00,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:00,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:00,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:00,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:00,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:00,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:00,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:00,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:00,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:00,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:00,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:00,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:00,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:00,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:00,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:00,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:00,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:00,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:01,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:01,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:01,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:01,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:01,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:01,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:01,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:01,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:01,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:01,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:01,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:01,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:01,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:01,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:35986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:01,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:01,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:01,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:01,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:01,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:01,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:02,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:02,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:02,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:02,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:02,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:02,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:02,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:02,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:02,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:02,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:02,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:02,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:02,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:02,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:02,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:02,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:02,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:02,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:03,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:03,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:03,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:03,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:03,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:03,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:03,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:03,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:03,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:03,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:03,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:03,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:03,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35371 2837s 2024-11-24 00:56:03,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:03,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35371': TLS handshake failed with remote 'tls://127.0.0.1:36184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:03,805 - distributed.scheduler - INFO - Scheduler closing due to unknown reason... 2837s 2024-11-24 00:56:03,806 - distributed.scheduler - INFO - Scheduler closing all comms 2837s _____________________________ test_gen_cluster_tls _____________________________ 2837s 2837s fut = , timeout = 0 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 2837s await self._register_with_scheduler() 2837s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2837s comm = await wait_for( 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 2837s return await fut 2837s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 2837s stream = await self.client.connect( 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s host = '127.0.0.1', port = 43419, af = 2837s ssl_options = 2837s max_buffer_size = 4151066624.0, source_ip = None, source_port = None 2837s timeout = None 2837s 2837s async def connect( 2837s self, 2837s host: str, 2837s port: int, 2837s af: socket.AddressFamily = socket.AF_UNSPEC, 2837s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 2837s max_buffer_size: Optional[int] = None, 2837s source_ip: Optional[str] = None, 2837s source_port: Optional[int] = None, 2837s timeout: Optional[Union[float, datetime.timedelta]] = None, 2837s ) -> IOStream: 2837s """Connect to the given host and port. 2837s 2837s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 2837s ``ssl_options`` is not None). 2837s 2837s Using the ``source_ip`` kwarg, one can specify the source 2837s IP address to use when establishing the connection. 2837s In case the user needs to resolve and 2837s use a specific interface, it has to be handled outside 2837s of Tornado as this depends very much on the platform. 2837s 2837s Raises `TimeoutError` if the input future does not complete before 2837s ``timeout``, which may be specified in any form allowed by 2837s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 2837s relative to `.IOLoop.time`) 2837s 2837s Similarly, when the user requires a certain source port, it can 2837s be specified using the ``source_port`` arg. 2837s 2837s .. versionchanged:: 4.5 2837s Added the ``source_ip`` and ``source_port`` arguments. 2837s 2837s .. versionchanged:: 5.0 2837s Added the ``timeout`` argument. 2837s """ 2837s if timeout is not None: 2837s if isinstance(timeout, numbers.Real): 2837s timeout = IOLoop.current().time() + timeout 2837s elif isinstance(timeout, datetime.timedelta): 2837s timeout = IOLoop.current().time() + timeout.total_seconds() 2837s else: 2837s raise TypeError("Unsupported timeout %r" % timeout) 2837s if timeout is not None: 2837s addrinfo = await gen.with_timeout( 2837s timeout, self.resolver.resolve(host, port, af) 2837s ) 2837s else: 2837s addrinfo = await self.resolver.resolve(host, port, af) 2837s connector = _Connector( 2837s addrinfo, 2837s functools.partial( 2837s self._create_stream, 2837s max_buffer_size, 2837s source_ip=source_ip, 2837s source_port=source_port, 2837s ), 2837s ) 2837s > af, addr, stream = await connector.start(connect_timeout=timeout) 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s > await wait_for(self.start_unsafe(), timeout=timeout) 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:664: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s @contextlib.asynccontextmanager 2837s async def _cluster_factory(): 2837s workers = [] 2837s s = None 2837s try: 2837s for _ in range(60): 2837s try: 2837s > s, ws = await start_cluster( 2837s nthreads, 2837s scheduler, 2837s security=security, 2837s Worker=Worker, 2837s scheduler_kwargs=scheduler_kwargs, 2837s worker_kwargs=merge( 2837s {"death_timeout": min(15, int(deadline.remaining))}, 2837s worker_kwargs, 2837s ), 2837s ) 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 2837s await asyncio.gather(*workers) 2837s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 2837s return await awaitable 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s 2837s @final 2837s async def start(self): 2837s async with self._startup_lock: 2837s if self.status == Status.failed: 2837s assert self.__startup_exc is not None 2837s raise self.__startup_exc 2837s elif self.status != Status.init: 2837s return self 2837s timeout = getattr(self, "death_timeout", None) 2837s 2837s async def _close_on_failure(exc: Exception) -> None: 2837s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2837s self.status = Status.failed 2837s self.__startup_exc = exc 2837s 2837s try: 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s except asyncio.TimeoutError as exc: 2837s await _close_on_failure(exc) 2837s > raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s E TimeoutError: Worker start timed out after 0s. 2837s 2837s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s fut = ._..test_func..async_fn at 0xe63f7717abc0> 2837s timeout = 60 2837s 2837s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2837s async with asyncio.timeout(timeout): 2837s > return await fut 2837s 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 2837s _cluster_factory() as (s, workers), 2837s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 2837s return await anext(self.gen) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 2837s await asyncio.sleep(1) 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s delay = 1, result = None 2837s 2837s async def sleep(delay, result=None): 2837s """Coroutine that completes after a given time (in seconds).""" 2837s if delay <= 0: 2837s await __sleep0() 2837s return result 2837s 2837s if math.isnan(delay): 2837s raise ValueError("Invalid delay: NaN (not a number)") 2837s 2837s loop = events.get_running_loop() 2837s future = loop.create_future() 2837s h = loop.call_later(delay, 2837s futures._set_result_unless_cancelled, 2837s future, result) 2837s try: 2837s > return await future 2837s E asyncio.exceptions.CancelledError 2837s 2837s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s args = (), kwds = {} 2837s 2837s @wraps(func) 2837s def inner(*args, **kwds): 2837s with self._recreate_cm(): 2837s > return func(*args, **kwds) 2837s 2837s /usr/lib/python3.13/contextlib.py:85: 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s /usr/lib/python3.13/contextlib.py:85: in inner 2837s return func(*args, **kwds) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 2837s return _run_and_close_tornado(async_fn_outer) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 2837s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 2837s /usr/lib/python3.13/asyncio/runners.py:194: in run 2837s return runner.run(main) 2837s /usr/lib/python3.13/asyncio/runners.py:118: in run 2837s return self._loop.run_until_complete(task) 2837s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 2837s return future.result() 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 2837s return await async_fn(*args, **kwargs) 2837s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 2837s return await utils_wait_for(async_fn(), timeout=timeout * 2) 2837s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 2837s async with asyncio.timeout(timeout): 2837s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2837s 2837s self = 2837s exc_type = 2837s exc_val = CancelledError(), exc_tb = 2837s 2837s async def __aexit__( 2837s self, 2837s exc_type: Optional[Type[BaseException]], 2837s exc_val: Optional[BaseException], 2837s exc_tb: Optional[TracebackType], 2837s ) -> Optional[bool]: 2837s assert self._state in (_State.ENTERED, _State.EXPIRING) 2837s 2837s if self._timeout_handler is not None: 2837s self._timeout_handler.cancel() 2837s self._timeout_handler = None 2837s 2837s if self._state is _State.EXPIRING: 2837s self._state = _State.EXPIRED 2837s 2837s if self._task.uncancel() <= self._cancelling and exc_type is not None: 2837s # Since there are no new cancel requests, we're 2837s # handling this. 2837s if issubclass(exc_type, exceptions.CancelledError): 2837s > raise TimeoutError from exc_val 2837s E TimeoutError 2837s 2837s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 2837s ----------------------------- Captured stderr call ----------------------------- 2837s 2024-11-24 00:56:14,761 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:56:14,765 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:14,765 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40533/status 2837s 2024-11-24 00:56:14,765 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:56:14,774 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38461 2837s 2024-11-24 00:56:14,774 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38461 2837s 2024-11-24 00:56:14,774 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:56:14,774 - distributed.worker - INFO - dashboard at: 127.0.0.1:39937 2837s 2024-11-24 00:56:14,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:14,774 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:14,774 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:56:14,774 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:14,774 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hqi9ow3d 2837s 2024-11-24 00:56:14,774 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:14,776 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33101 2837s 2024-11-24 00:56:14,776 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33101 2837s 2024-11-24 00:56:14,776 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:56:14,776 - distributed.worker - INFO - dashboard at: 127.0.0.1:45415 2837s 2024-11-24 00:56:14,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:14,776 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:14,776 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:56:14,776 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:14,776 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-920k00h6 2837s 2024-11-24 00:56:14,776 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:14,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:14,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:14,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:49182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:14,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:49190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:14,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:14,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:14,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:49192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:14,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:49200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:49210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:49226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:49240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:49248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:49252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:49254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:15,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:15,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:16,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:16,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:17,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:17,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:18,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:18,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:19,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:19,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:34998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:20,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:20,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:21,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:21,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:22,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:22,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:23,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:23,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:24,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:24,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:35780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:25,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:25,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:39996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:26,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:26,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:27,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:27,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:28,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:28,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:29,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:29,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:29,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:29,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:29,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:29,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:29,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:29,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:29,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:29,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:29,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:29,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:29,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:29,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:29,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:29,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:29,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:29,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:29,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:29,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:29,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:29,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:29,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:29,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:29,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:29,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:29,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:29,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:29,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:29,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:29,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40569 2837s 2024-11-24 00:56:29,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40569': TLS handshake failed with remote 'tls://127.0.0.1:40566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:29,773 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38461. Reason: failure-to-start- 2837s 2024-11-24 00:56:29,773 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:29,774 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 15s. 2837s 2024-11-24 00:56:29,777 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33101. Reason: failure-to-start- 2837s 2024-11-24 00:56:29,777 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:30,779 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:56:30,783 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:30,783 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36927/status 2837s 2024-11-24 00:56:30,784 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:56:30,792 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36983 2837s 2024-11-24 00:56:30,792 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36983 2837s 2024-11-24 00:56:30,792 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:56:30,793 - distributed.worker - INFO - dashboard at: 127.0.0.1:46151 2837s 2024-11-24 00:56:30,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:30,793 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:30,793 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:56:30,793 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:30,793 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eheyduev 2837s 2024-11-24 00:56:30,793 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:30,794 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39281 2837s 2024-11-24 00:56:30,794 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39281 2837s 2024-11-24 00:56:30,794 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:56:30,794 - distributed.worker - INFO - dashboard at: 127.0.0.1:34469 2837s 2024-11-24 00:56:30,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:30,794 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:30,794 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:56:30,794 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:30,794 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pu2wswdd 2837s 2024-11-24 00:56:30,795 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:30,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:30,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:30,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:30,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:30,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:30,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:30,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:30,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:37986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:31,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:31,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:32,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:32,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:33,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:33,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:34,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:34,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:38592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:35,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:35,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:36,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:36,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:37,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:37,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:38,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:38,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:39,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:39,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:33998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:40,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:40,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:41,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:41,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:42,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:42,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:43,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:43,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:43,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:43,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:43,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:43,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:43,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:43,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:43,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:43,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:43,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:43,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:43,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:43,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:43,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:43,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:43,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:43,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:43,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:43,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:43,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:43,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:43,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:43,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:43,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:43,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:43,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35675 2837s 2024-11-24 00:56:43,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35675': TLS handshake failed with remote 'tls://127.0.0.1:34582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 2837s 2024-11-24 00:56:43,792 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36983. Reason: failure-to-start- 2837s 2024-11-24 00:56:43,792 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:43,793 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 2837s stream = await stream.start_tls( 2837s ^^^^^^^^^^^^^^^^^^^^^^^ 2837s False, ssl_options=ssl_options, server_hostname=host 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 2837s self.socket.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 2837s self._sslobj.do_handshake() 2837s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2837s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 2837s raise FatalCommClosedError( 2837s ...<2 lines>... 2837s ) from err 2837s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s 2837s During handling of the above exception, another exception occurred: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 2837s await asyncio.sleep(0.1) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 2837s return await future 2837s ^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 13s. 2837s 2024-11-24 00:56:43,797 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39281. Reason: failure-to-start- 2837s 2024-11-24 00:56:43,797 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:44,799 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:56:44,803 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40347 2837s 2024-11-24 00:56:44,803 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38671/status 2837s 2024-11-24 00:56:44,804 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:56:44,813 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42539 2837s 2024-11-24 00:56:44,813 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42539 2837s 2024-11-24 00:56:44,813 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:56:44,813 - distributed.worker - INFO - dashboard at: 127.0.0.1:40437 2837s 2024-11-24 00:56:44,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40347 2837s 2024-11-24 00:56:44,813 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:44,813 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:56:44,813 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:44,813 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rmz63h_s 2837s 2024-11-24 00:56:44,813 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:44,815 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39983 2837s 2024-11-24 00:56:44,815 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39983 2837s 2024-11-24 00:56:44,815 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:56:44,815 - distributed.worker - INFO - dashboard at: 127.0.0.1:37043 2837s 2024-11-24 00:56:44,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40347 2837s 2024-11-24 00:56:44,815 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:44,815 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:56:44,815 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:44,815 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bph_r83s 2837s 2024-11-24 00:56:44,815 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:44,816 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42539. Reason: failure-to-start- 2837s 2024-11-24 00:56:44,816 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:44,817 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39983. Reason: failure-to-start- 2837s 2024-11-24 00:56:44,817 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:44,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40347': TLS handshake failed with remote 'tls://127.0.0.1:56608': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:44,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40347': TLS handshake failed with remote 'tls://127.0.0.1:56622': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:44,819 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:56:45,823 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:56:45,827 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46703 2837s 2024-11-24 00:56:45,828 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34443/status 2837s 2024-11-24 00:56:45,828 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:56:45,836 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40451 2837s 2024-11-24 00:56:45,836 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40451 2837s 2024-11-24 00:56:45,836 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:56:45,836 - distributed.worker - INFO - dashboard at: 127.0.0.1:46707 2837s 2024-11-24 00:56:45,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46703 2837s 2024-11-24 00:56:45,836 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:45,836 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:56:45,836 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:45,836 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jsc_5m2b 2837s 2024-11-24 00:56:45,836 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:45,838 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36063 2837s 2024-11-24 00:56:45,838 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36063 2837s 2024-11-24 00:56:45,838 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:56:45,838 - distributed.worker - INFO - dashboard at: 127.0.0.1:42789 2837s 2024-11-24 00:56:45,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46703 2837s 2024-11-24 00:56:45,838 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:45,838 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:56:45,838 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:45,838 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-47070br7 2837s 2024-11-24 00:56:45,838 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:45,839 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40451. Reason: failure-to-start- 2837s 2024-11-24 00:56:45,839 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:45,840 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36063. Reason: failure-to-start- 2837s 2024-11-24 00:56:45,840 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:45,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46703': TLS handshake failed with remote 'tls://127.0.0.1:43690': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:45,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46703': TLS handshake failed with remote 'tls://127.0.0.1:43692': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:45,842 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:56:46,847 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:56:46,851 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38691 2837s 2024-11-24 00:56:46,851 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40177/status 2837s 2024-11-24 00:56:46,851 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:56:46,858 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43551 2837s 2024-11-24 00:56:46,859 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43551 2837s 2024-11-24 00:56:46,859 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:56:46,859 - distributed.worker - INFO - dashboard at: 127.0.0.1:45991 2837s 2024-11-24 00:56:46,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38691 2837s 2024-11-24 00:56:46,859 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:46,859 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:56:46,859 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:46,859 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-he40ycuz 2837s 2024-11-24 00:56:46,859 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:46,860 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40993 2837s 2024-11-24 00:56:46,861 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40993 2837s 2024-11-24 00:56:46,861 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:56:46,861 - distributed.worker - INFO - dashboard at: 127.0.0.1:35667 2837s 2024-11-24 00:56:46,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38691 2837s 2024-11-24 00:56:46,861 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:46,861 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:56:46,861 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:46,861 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j24uu96k 2837s 2024-11-24 00:56:46,861 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:46,862 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43551. Reason: failure-to-start- 2837s 2024-11-24 00:56:46,862 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:46,862 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40993. Reason: failure-to-start- 2837s 2024-11-24 00:56:46,862 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:46,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38691': TLS handshake failed with remote 'tls://127.0.0.1:60520': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:46,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38691': TLS handshake failed with remote 'tls://127.0.0.1:60524': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:46,864 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:56:47,869 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:56:47,873 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44989 2837s 2024-11-24 00:56:47,873 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35335/status 2837s 2024-11-24 00:56:47,873 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:56:47,882 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40165 2837s 2024-11-24 00:56:47,883 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40165 2837s 2024-11-24 00:56:47,883 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:56:47,883 - distributed.worker - INFO - dashboard at: 127.0.0.1:35855 2837s 2024-11-24 00:56:47,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44989 2837s 2024-11-24 00:56:47,883 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:47,883 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:56:47,883 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:47,883 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6irc4ubd 2837s 2024-11-24 00:56:47,883 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:47,884 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44571 2837s 2024-11-24 00:56:47,885 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44571 2837s 2024-11-24 00:56:47,885 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:56:47,885 - distributed.worker - INFO - dashboard at: 127.0.0.1:45939 2837s 2024-11-24 00:56:47,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44989 2837s 2024-11-24 00:56:47,885 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:47,885 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:56:47,885 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:47,885 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lzcugs30 2837s 2024-11-24 00:56:47,885 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:47,886 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40165. Reason: failure-to-start- 2837s 2024-11-24 00:56:47,886 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:47,886 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44571. Reason: failure-to-start- 2837s 2024-11-24 00:56:47,886 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:47,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44989': TLS handshake failed with remote 'tls://127.0.0.1:58764': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:47,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44989': TLS handshake failed with remote 'tls://127.0.0.1:58778': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:47,889 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:56:48,893 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:56:48,897 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39227 2837s 2024-11-24 00:56:48,898 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34817/status 2837s 2024-11-24 00:56:48,898 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:56:48,907 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40045 2837s 2024-11-24 00:56:48,907 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40045 2837s 2024-11-24 00:56:48,907 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:56:48,907 - distributed.worker - INFO - dashboard at: 127.0.0.1:36615 2837s 2024-11-24 00:56:48,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39227 2837s 2024-11-24 00:56:48,907 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:48,907 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:56:48,907 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:48,907 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4emqu23p 2837s 2024-11-24 00:56:48,907 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:48,909 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34983 2837s 2024-11-24 00:56:48,910 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34983 2837s 2024-11-24 00:56:48,910 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:56:48,910 - distributed.worker - INFO - dashboard at: 127.0.0.1:40407 2837s 2024-11-24 00:56:48,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39227 2837s 2024-11-24 00:56:48,910 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:48,910 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:56:48,910 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:48,910 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k0kf8_qa 2837s 2024-11-24 00:56:48,910 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:48,911 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40045. Reason: failure-to-start- 2837s 2024-11-24 00:56:48,911 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:48,911 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34983. Reason: failure-to-start- 2837s 2024-11-24 00:56:48,911 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:48,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39227': TLS handshake failed with remote 'tls://127.0.0.1:53726': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:48,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39227': TLS handshake failed with remote 'tls://127.0.0.1:53738': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:48,914 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:56:49,918 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:56:49,922 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45503 2837s 2024-11-24 00:56:49,922 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41497/status 2837s 2024-11-24 00:56:49,922 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:56:49,931 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40977 2837s 2024-11-24 00:56:49,931 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40977 2837s 2024-11-24 00:56:49,931 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:56:49,931 - distributed.worker - INFO - dashboard at: 127.0.0.1:36063 2837s 2024-11-24 00:56:49,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45503 2837s 2024-11-24 00:56:49,931 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:49,931 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:56:49,931 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:49,931 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jame9_29 2837s 2024-11-24 00:56:49,931 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:49,933 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36841 2837s 2024-11-24 00:56:49,933 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36841 2837s 2024-11-24 00:56:49,933 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:56:49,933 - distributed.worker - INFO - dashboard at: 127.0.0.1:37121 2837s 2024-11-24 00:56:49,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45503 2837s 2024-11-24 00:56:49,933 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:49,933 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:56:49,933 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:49,933 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rhbk1az7 2837s 2024-11-24 00:56:49,933 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:49,934 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40977. Reason: failure-to-start- 2837s 2024-11-24 00:56:49,934 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:49,935 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36841. Reason: failure-to-start- 2837s 2024-11-24 00:56:49,935 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:49,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45503': TLS handshake failed with remote 'tls://127.0.0.1:60068': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:49,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45503': TLS handshake failed with remote 'tls://127.0.0.1:60082': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:49,937 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:56:50,943 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:56:50,947 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33029 2837s 2024-11-24 00:56:50,947 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45729/status 2837s 2024-11-24 00:56:50,948 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:56:50,956 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44291 2837s 2024-11-24 00:56:50,956 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44291 2837s 2024-11-24 00:56:50,956 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:56:50,956 - distributed.worker - INFO - dashboard at: 127.0.0.1:40857 2837s 2024-11-24 00:56:50,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33029 2837s 2024-11-24 00:56:50,956 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:50,956 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:56:50,956 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:50,956 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ls2707kx 2837s 2024-11-24 00:56:50,956 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:50,958 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36767 2837s 2024-11-24 00:56:50,958 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36767 2837s 2024-11-24 00:56:50,958 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:56:50,958 - distributed.worker - INFO - dashboard at: 127.0.0.1:34405 2837s 2024-11-24 00:56:50,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33029 2837s 2024-11-24 00:56:50,958 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:50,958 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:56:50,958 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:50,958 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vfg3pyh1 2837s 2024-11-24 00:56:50,958 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:50,959 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44291. Reason: failure-to-start- 2837s 2024-11-24 00:56:50,959 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:50,959 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36767. Reason: failure-to-start- 2837s 2024-11-24 00:56:50,960 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:50,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33029': TLS handshake failed with remote 'tls://127.0.0.1:47614': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:50,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33029': TLS handshake failed with remote 'tls://127.0.0.1:47626': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:50,962 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:56:51,966 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:56:51,970 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41297 2837s 2024-11-24 00:56:51,970 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37455/status 2837s 2024-11-24 00:56:51,970 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:56:51,980 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37127 2837s 2024-11-24 00:56:51,980 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37127 2837s 2024-11-24 00:56:51,980 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:56:51,980 - distributed.worker - INFO - dashboard at: 127.0.0.1:42525 2837s 2024-11-24 00:56:51,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41297 2837s 2024-11-24 00:56:51,980 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:51,980 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:56:51,980 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:51,980 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y493ttxo 2837s 2024-11-24 00:56:51,980 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:51,982 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44195 2837s 2024-11-24 00:56:51,982 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44195 2837s 2024-11-24 00:56:51,982 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:56:51,982 - distributed.worker - INFO - dashboard at: 127.0.0.1:43025 2837s 2024-11-24 00:56:51,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41297 2837s 2024-11-24 00:56:51,982 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:51,982 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:56:51,982 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:51,982 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_tt5uvq9 2837s 2024-11-24 00:56:51,982 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:51,983 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37127. Reason: failure-to-start- 2837s 2024-11-24 00:56:51,983 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:51,983 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44195. Reason: failure-to-start- 2837s 2024-11-24 00:56:51,984 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:51,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41297': TLS handshake failed with remote 'tls://127.0.0.1:33406': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:51,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41297': TLS handshake failed with remote 'tls://127.0.0.1:33412': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:51,986 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:56:52,991 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:56:52,995 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44261 2837s 2024-11-24 00:56:52,995 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40857/status 2837s 2024-11-24 00:56:52,995 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:56:53,003 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43327 2837s 2024-11-24 00:56:53,003 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43327 2837s 2024-11-24 00:56:53,004 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:56:53,004 - distributed.worker - INFO - dashboard at: 127.0.0.1:41231 2837s 2024-11-24 00:56:53,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44261 2837s 2024-11-24 00:56:53,004 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:53,004 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:56:53,004 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:53,004 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rkl94667 2837s 2024-11-24 00:56:53,004 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:53,006 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42913 2837s 2024-11-24 00:56:53,006 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42913 2837s 2024-11-24 00:56:53,006 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:56:53,006 - distributed.worker - INFO - dashboard at: 127.0.0.1:32897 2837s 2024-11-24 00:56:53,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44261 2837s 2024-11-24 00:56:53,006 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:53,006 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:56:53,007 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:53,007 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ghd5r_a3 2837s 2024-11-24 00:56:53,007 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:53,008 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43327. Reason: failure-to-start- 2837s 2024-11-24 00:56:53,008 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:53,008 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42913. Reason: failure-to-start- 2837s 2024-11-24 00:56:53,008 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:53,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44261': TLS handshake failed with remote 'tls://127.0.0.1:57744': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:53,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44261': TLS handshake failed with remote 'tls://127.0.0.1:57756': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:53,010 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:56:54,016 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:56:54,020 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38055 2837s 2024-11-24 00:56:54,020 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37449/status 2837s 2024-11-24 00:56:54,021 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:56:54,029 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36099 2837s 2024-11-24 00:56:54,029 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36099 2837s 2024-11-24 00:56:54,029 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:56:54,029 - distributed.worker - INFO - dashboard at: 127.0.0.1:34465 2837s 2024-11-24 00:56:54,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38055 2837s 2024-11-24 00:56:54,029 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:54,029 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:56:54,029 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:54,029 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wvpdk_yd 2837s 2024-11-24 00:56:54,029 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:54,031 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40059 2837s 2024-11-24 00:56:54,031 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40059 2837s 2024-11-24 00:56:54,031 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:56:54,031 - distributed.worker - INFO - dashboard at: 127.0.0.1:45203 2837s 2024-11-24 00:56:54,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38055 2837s 2024-11-24 00:56:54,031 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:54,031 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:56:54,031 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:54,031 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8y8l9g9a 2837s 2024-11-24 00:56:54,031 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:54,032 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36099. Reason: failure-to-start- 2837s 2024-11-24 00:56:54,032 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:54,033 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40059. Reason: failure-to-start- 2837s 2024-11-24 00:56:54,033 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:54,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38055': TLS handshake failed with remote 'tls://127.0.0.1:54654': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:54,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38055': TLS handshake failed with remote 'tls://127.0.0.1:54660': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:54,035 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:56:55,040 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:56:55,044 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40053 2837s 2024-11-24 00:56:55,044 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46709/status 2837s 2024-11-24 00:56:55,044 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:56:55,052 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43771 2837s 2024-11-24 00:56:55,052 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43771 2837s 2024-11-24 00:56:55,052 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:56:55,052 - distributed.worker - INFO - dashboard at: 127.0.0.1:43139 2837s 2024-11-24 00:56:55,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40053 2837s 2024-11-24 00:56:55,053 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:55,053 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:56:55,053 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:55,053 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rle92wni 2837s 2024-11-24 00:56:55,053 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:55,054 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43739 2837s 2024-11-24 00:56:55,054 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43739 2837s 2024-11-24 00:56:55,054 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:56:55,054 - distributed.worker - INFO - dashboard at: 127.0.0.1:33365 2837s 2024-11-24 00:56:55,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40053 2837s 2024-11-24 00:56:55,055 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:55,055 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:56:55,055 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:55,055 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x2zst9fj 2837s 2024-11-24 00:56:55,055 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:55,056 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43771. Reason: failure-to-start- 2837s 2024-11-24 00:56:55,056 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:55,056 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43739. Reason: failure-to-start- 2837s 2024-11-24 00:56:55,056 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:55,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40053': TLS handshake failed with remote 'tls://127.0.0.1:56646': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:55,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40053': TLS handshake failed with remote 'tls://127.0.0.1:56658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:55,058 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:56:56,063 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:56:56,067 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34277 2837s 2024-11-24 00:56:56,067 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37287/status 2837s 2024-11-24 00:56:56,067 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:56:56,083 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41771 2837s 2024-11-24 00:56:56,083 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41771 2837s 2024-11-24 00:56:56,083 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:56:56,083 - distributed.worker - INFO - dashboard at: 127.0.0.1:40547 2837s 2024-11-24 00:56:56,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34277 2837s 2024-11-24 00:56:56,083 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:56,083 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:56:56,083 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:56,083 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e0csr734 2837s 2024-11-24 00:56:56,083 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:56,085 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34997 2837s 2024-11-24 00:56:56,085 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34997 2837s 2024-11-24 00:56:56,085 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:56:56,085 - distributed.worker - INFO - dashboard at: 127.0.0.1:38441 2837s 2024-11-24 00:56:56,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34277 2837s 2024-11-24 00:56:56,085 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:56,085 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:56:56,085 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:56,085 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3aoytw1d 2837s 2024-11-24 00:56:56,085 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:56,086 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41771. Reason: failure-to-start- 2837s 2024-11-24 00:56:56,086 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:56,086 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34997. Reason: failure-to-start- 2837s 2024-11-24 00:56:56,086 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:56,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34277': TLS handshake failed with remote 'tls://127.0.0.1:57808': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:56,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34277': TLS handshake failed with remote 'tls://127.0.0.1:57822': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:56,088 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:56:57,092 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:56:57,096 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43153 2837s 2024-11-24 00:56:57,096 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39053/status 2837s 2024-11-24 00:56:57,097 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:56:57,106 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39809 2837s 2024-11-24 00:56:57,106 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39809 2837s 2024-11-24 00:56:57,106 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:56:57,106 - distributed.worker - INFO - dashboard at: 127.0.0.1:34629 2837s 2024-11-24 00:56:57,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43153 2837s 2024-11-24 00:56:57,107 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:57,107 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:56:57,107 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:57,107 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-89d044up 2837s 2024-11-24 00:56:57,107 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:57,108 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34473 2837s 2024-11-24 00:56:57,108 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34473 2837s 2024-11-24 00:56:57,109 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:56:57,109 - distributed.worker - INFO - dashboard at: 127.0.0.1:37631 2837s 2024-11-24 00:56:57,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43153 2837s 2024-11-24 00:56:57,109 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:57,109 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:56:57,109 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:57,109 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fc0br23e 2837s 2024-11-24 00:56:57,109 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:57,110 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39809. Reason: failure-to-start- 2837s 2024-11-24 00:56:57,110 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:57,110 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34473. Reason: failure-to-start- 2837s 2024-11-24 00:56:57,110 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:57,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43153': TLS handshake failed with remote 'tls://127.0.0.1:55966': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:57,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43153': TLS handshake failed with remote 'tls://127.0.0.1:55970': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:57,112 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:56:58,116 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:56:58,120 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40147 2837s 2024-11-24 00:56:58,120 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37423/status 2837s 2024-11-24 00:56:58,121 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:56:58,129 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44299 2837s 2024-11-24 00:56:58,129 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44299 2837s 2024-11-24 00:56:58,129 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:56:58,129 - distributed.worker - INFO - dashboard at: 127.0.0.1:39427 2837s 2024-11-24 00:56:58,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40147 2837s 2024-11-24 00:56:58,129 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:58,129 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:56:58,129 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:58,129 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hfitopip 2837s 2024-11-24 00:56:58,129 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:58,130 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37859 2837s 2024-11-24 00:56:58,130 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37859 2837s 2024-11-24 00:56:58,131 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:56:58,131 - distributed.worker - INFO - dashboard at: 127.0.0.1:42213 2837s 2024-11-24 00:56:58,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40147 2837s 2024-11-24 00:56:58,131 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:58,131 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:56:58,131 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:58,131 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wv3ifu06 2837s 2024-11-24 00:56:58,131 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:58,132 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44299. Reason: failure-to-start- 2837s 2024-11-24 00:56:58,132 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:58,132 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37859. Reason: failure-to-start- 2837s 2024-11-24 00:56:58,132 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:58,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40147': TLS handshake failed with remote 'tls://127.0.0.1:44896': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:58,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40147': TLS handshake failed with remote 'tls://127.0.0.1:44898': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:58,134 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:56:59,138 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:56:59,142 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42335 2837s 2024-11-24 00:56:59,142 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43093/status 2837s 2024-11-24 00:56:59,142 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:56:59,151 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39759 2837s 2024-11-24 00:56:59,152 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39759 2837s 2024-11-24 00:56:59,152 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:56:59,152 - distributed.worker - INFO - dashboard at: 127.0.0.1:41483 2837s 2024-11-24 00:56:59,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42335 2837s 2024-11-24 00:56:59,152 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:59,152 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:56:59,152 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:59,152 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bbr8c7s0 2837s 2024-11-24 00:56:59,152 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:59,154 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34535 2837s 2024-11-24 00:56:59,154 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34535 2837s 2024-11-24 00:56:59,154 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:56:59,154 - distributed.worker - INFO - dashboard at: 127.0.0.1:42707 2837s 2024-11-24 00:56:59,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42335 2837s 2024-11-24 00:56:59,154 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:59,154 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:56:59,154 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:56:59,154 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-36_6i83l 2837s 2024-11-24 00:56:59,154 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:56:59,155 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39759. Reason: failure-to-start- 2837s 2024-11-24 00:56:59,155 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:59,156 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34535. Reason: failure-to-start- 2837s 2024-11-24 00:56:59,156 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:56:59,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42335': TLS handshake failed with remote 'tls://127.0.0.1:55928': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:59,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42335': TLS handshake failed with remote 'tls://127.0.0.1:55936': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:56:59,158 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:57:00,164 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:57:00,168 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42479 2837s 2024-11-24 00:57:00,169 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43257/status 2837s 2024-11-24 00:57:00,169 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:57:00,177 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43599 2837s 2024-11-24 00:57:00,177 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43599 2837s 2024-11-24 00:57:00,177 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:57:00,177 - distributed.worker - INFO - dashboard at: 127.0.0.1:36797 2837s 2024-11-24 00:57:00,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42479 2837s 2024-11-24 00:57:00,177 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:00,177 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:57:00,177 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:00,177 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3ynr6pf4 2837s 2024-11-24 00:57:00,177 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:00,179 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34281 2837s 2024-11-24 00:57:00,179 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34281 2837s 2024-11-24 00:57:00,179 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:57:00,179 - distributed.worker - INFO - dashboard at: 127.0.0.1:37229 2837s 2024-11-24 00:57:00,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42479 2837s 2024-11-24 00:57:00,179 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:00,179 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:57:00,179 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:00,179 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7nu0a9bj 2837s 2024-11-24 00:57:00,179 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:00,180 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43599. Reason: failure-to-start- 2837s 2024-11-24 00:57:00,180 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:00,180 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34281. Reason: failure-to-start- 2837s 2024-11-24 00:57:00,180 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:00,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42479': TLS handshake failed with remote 'tls://127.0.0.1:60620': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:00,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42479': TLS handshake failed with remote 'tls://127.0.0.1:60632': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:00,183 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:57:01,188 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:57:01,192 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44689 2837s 2024-11-24 00:57:01,192 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46851/status 2837s 2024-11-24 00:57:01,192 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:57:01,203 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39331 2837s 2024-11-24 00:57:01,203 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39331 2837s 2024-11-24 00:57:01,203 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:57:01,203 - distributed.worker - INFO - dashboard at: 127.0.0.1:42975 2837s 2024-11-24 00:57:01,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44689 2837s 2024-11-24 00:57:01,203 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:01,203 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:57:01,203 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:01,203 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kn33u5n5 2837s 2024-11-24 00:57:01,203 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:01,205 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45197 2837s 2024-11-24 00:57:01,205 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45197 2837s 2024-11-24 00:57:01,205 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:57:01,205 - distributed.worker - INFO - dashboard at: 127.0.0.1:37175 2837s 2024-11-24 00:57:01,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44689 2837s 2024-11-24 00:57:01,205 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:01,205 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:57:01,205 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:01,205 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9mkhoorz 2837s 2024-11-24 00:57:01,205 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:01,206 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39331. Reason: failure-to-start- 2837s 2024-11-24 00:57:01,206 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:01,207 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45197. Reason: failure-to-start- 2837s 2024-11-24 00:57:01,207 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:01,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44689': TLS handshake failed with remote 'tls://127.0.0.1:48408': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:01,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44689': TLS handshake failed with remote 'tls://127.0.0.1:48414': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:01,209 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:57:02,214 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:57:02,218 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44575 2837s 2024-11-24 00:57:02,218 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44767/status 2837s 2024-11-24 00:57:02,218 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:57:02,227 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35891 2837s 2024-11-24 00:57:02,227 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35891 2837s 2024-11-24 00:57:02,227 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:57:02,227 - distributed.worker - INFO - dashboard at: 127.0.0.1:38459 2837s 2024-11-24 00:57:02,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44575 2837s 2024-11-24 00:57:02,227 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:02,227 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:57:02,227 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:02,227 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-18o31xff 2837s 2024-11-24 00:57:02,227 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:02,229 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34737 2837s 2024-11-24 00:57:02,229 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34737 2837s 2024-11-24 00:57:02,229 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:57:02,229 - distributed.worker - INFO - dashboard at: 127.0.0.1:35937 2837s 2024-11-24 00:57:02,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44575 2837s 2024-11-24 00:57:02,230 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:02,230 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:57:02,230 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:02,230 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yncfm_hg 2837s 2024-11-24 00:57:02,230 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:02,231 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35891. Reason: failure-to-start- 2837s 2024-11-24 00:57:02,231 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:02,231 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34737. Reason: failure-to-start- 2837s 2024-11-24 00:57:02,231 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:02,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44575': TLS handshake failed with remote 'tls://127.0.0.1:54876': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:02,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44575': TLS handshake failed with remote 'tls://127.0.0.1:54886': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:02,234 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:57:03,238 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:57:03,244 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38779 2837s 2024-11-24 00:57:03,244 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38799/status 2837s 2024-11-24 00:57:03,244 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:57:03,253 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38667 2837s 2024-11-24 00:57:03,253 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38667 2837s 2024-11-24 00:57:03,253 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:57:03,253 - distributed.worker - INFO - dashboard at: 127.0.0.1:37151 2837s 2024-11-24 00:57:03,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38779 2837s 2024-11-24 00:57:03,253 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:03,253 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:57:03,253 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:03,253 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bch0vv9b 2837s 2024-11-24 00:57:03,253 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:03,255 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45081 2837s 2024-11-24 00:57:03,255 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45081 2837s 2024-11-24 00:57:03,255 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:57:03,255 - distributed.worker - INFO - dashboard at: 127.0.0.1:33805 2837s 2024-11-24 00:57:03,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38779 2837s 2024-11-24 00:57:03,255 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:03,255 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:57:03,255 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:03,256 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6jd_ks8s 2837s 2024-11-24 00:57:03,256 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:03,256 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38667. Reason: failure-to-start- 2837s 2024-11-24 00:57:03,257 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:03,257 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45081. Reason: failure-to-start- 2837s 2024-11-24 00:57:03,257 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:03,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38779': TLS handshake failed with remote 'tls://127.0.0.1:49506': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:03,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38779': TLS handshake failed with remote 'tls://127.0.0.1:49516': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:03,260 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:57:04,266 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:57:04,270 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45431 2837s 2024-11-24 00:57:04,270 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39369/status 2837s 2024-11-24 00:57:04,270 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:57:04,279 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39433 2837s 2024-11-24 00:57:04,280 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39433 2837s 2024-11-24 00:57:04,280 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:57:04,280 - distributed.worker - INFO - dashboard at: 127.0.0.1:33421 2837s 2024-11-24 00:57:04,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45431 2837s 2024-11-24 00:57:04,280 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:04,280 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:57:04,280 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:04,280 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p408hs5v 2837s 2024-11-24 00:57:04,280 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:04,281 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42575 2837s 2024-11-24 00:57:04,281 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42575 2837s 2024-11-24 00:57:04,282 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:57:04,282 - distributed.worker - INFO - dashboard at: 127.0.0.1:35663 2837s 2024-11-24 00:57:04,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45431 2837s 2024-11-24 00:57:04,282 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:04,282 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:57:04,282 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:04,282 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a04qqy_2 2837s 2024-11-24 00:57:04,282 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:04,283 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39433. Reason: failure-to-start- 2837s 2024-11-24 00:57:04,283 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:04,283 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42575. Reason: failure-to-start- 2837s 2024-11-24 00:57:04,283 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:04,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45431': TLS handshake failed with remote 'tls://127.0.0.1:43574': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:04,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45431': TLS handshake failed with remote 'tls://127.0.0.1:43580': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:04,288 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:57:05,293 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:57:05,297 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41921 2837s 2024-11-24 00:57:05,297 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45227/status 2837s 2024-11-24 00:57:05,297 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:57:05,307 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38947 2837s 2024-11-24 00:57:05,307 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38947 2837s 2024-11-24 00:57:05,307 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:57:05,307 - distributed.worker - INFO - dashboard at: 127.0.0.1:36703 2837s 2024-11-24 00:57:05,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41921 2837s 2024-11-24 00:57:05,307 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:05,307 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:57:05,307 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:05,307 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v85mjrt5 2837s 2024-11-24 00:57:05,307 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:05,309 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38611 2837s 2024-11-24 00:57:05,309 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38611 2837s 2024-11-24 00:57:05,309 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:57:05,309 - distributed.worker - INFO - dashboard at: 127.0.0.1:45955 2837s 2024-11-24 00:57:05,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41921 2837s 2024-11-24 00:57:05,309 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:05,309 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:57:05,309 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:05,309 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3295pjo_ 2837s 2024-11-24 00:57:05,309 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:05,311 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38947. Reason: failure-to-start- 2837s 2024-11-24 00:57:05,311 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:05,311 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38611. Reason: failure-to-start- 2837s 2024-11-24 00:57:05,311 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:05,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41921': TLS handshake failed with remote 'tls://127.0.0.1:44780': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:05,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41921': TLS handshake failed with remote 'tls://127.0.0.1:44792': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:05,313 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:57:06,318 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:57:06,322 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41009 2837s 2024-11-24 00:57:06,322 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42483/status 2837s 2024-11-24 00:57:06,323 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:57:06,333 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45267 2837s 2024-11-24 00:57:06,333 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45267 2837s 2024-11-24 00:57:06,333 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:57:06,333 - distributed.worker - INFO - dashboard at: 127.0.0.1:40537 2837s 2024-11-24 00:57:06,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41009 2837s 2024-11-24 00:57:06,333 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:06,333 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:57:06,333 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:06,333 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8sui02ms 2837s 2024-11-24 00:57:06,333 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:06,335 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44415 2837s 2024-11-24 00:57:06,335 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44415 2837s 2024-11-24 00:57:06,335 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:57:06,335 - distributed.worker - INFO - dashboard at: 127.0.0.1:42195 2837s 2024-11-24 00:57:06,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41009 2837s 2024-11-24 00:57:06,335 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:06,335 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:57:06,335 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:06,335 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tea5bgan 2837s 2024-11-24 00:57:06,335 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:06,337 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45267. Reason: failure-to-start- 2837s 2024-11-24 00:57:06,337 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:06,337 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44415. Reason: failure-to-start- 2837s 2024-11-24 00:57:06,338 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:06,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41009': TLS handshake failed with remote 'tls://127.0.0.1:47418': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:06,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41009': TLS handshake failed with remote 'tls://127.0.0.1:47430': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:06,340 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:57:07,345 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:57:07,349 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34949 2837s 2024-11-24 00:57:07,349 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40999/status 2837s 2024-11-24 00:57:07,349 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:57:07,358 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37517 2837s 2024-11-24 00:57:07,358 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37517 2837s 2024-11-24 00:57:07,358 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:57:07,358 - distributed.worker - INFO - dashboard at: 127.0.0.1:42199 2837s 2024-11-24 00:57:07,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34949 2837s 2024-11-24 00:57:07,358 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:07,358 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:57:07,358 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:07,358 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1xx8wnce 2837s 2024-11-24 00:57:07,358 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:07,359 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37353 2837s 2024-11-24 00:57:07,360 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37353 2837s 2024-11-24 00:57:07,360 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:57:07,360 - distributed.worker - INFO - dashboard at: 127.0.0.1:40745 2837s 2024-11-24 00:57:07,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34949 2837s 2024-11-24 00:57:07,360 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:07,360 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:57:07,360 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:07,360 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3g2bz7ho 2837s 2024-11-24 00:57:07,360 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:07,362 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37517. Reason: failure-to-start- 2837s 2024-11-24 00:57:07,362 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:07,363 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37353. Reason: failure-to-start- 2837s 2024-11-24 00:57:07,363 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:07,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34949': TLS handshake failed with remote 'tls://127.0.0.1:37790': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:07,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34949': TLS handshake failed with remote 'tls://127.0.0.1:37804': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:07,365 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:57:08,370 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:57:08,374 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42297 2837s 2024-11-24 00:57:08,374 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33165/status 2837s 2024-11-24 00:57:08,375 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:57:08,384 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43741 2837s 2024-11-24 00:57:08,384 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43741 2837s 2024-11-24 00:57:08,384 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:57:08,384 - distributed.worker - INFO - dashboard at: 127.0.0.1:43115 2837s 2024-11-24 00:57:08,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42297 2837s 2024-11-24 00:57:08,385 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:08,385 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:57:08,385 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:08,385 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-db8mbx0u 2837s 2024-11-24 00:57:08,385 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:08,386 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41671 2837s 2024-11-24 00:57:08,386 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41671 2837s 2024-11-24 00:57:08,386 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:57:08,387 - distributed.worker - INFO - dashboard at: 127.0.0.1:43461 2837s 2024-11-24 00:57:08,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42297 2837s 2024-11-24 00:57:08,387 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:08,387 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:57:08,387 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:08,387 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pvylf3w_ 2837s 2024-11-24 00:57:08,387 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:08,388 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43741. Reason: failure-to-start- 2837s 2024-11-24 00:57:08,388 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:08,388 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41671. Reason: failure-to-start- 2837s 2024-11-24 00:57:08,388 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:08,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42297': TLS handshake failed with remote 'tls://127.0.0.1:32806': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:08,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42297': TLS handshake failed with remote 'tls://127.0.0.1:32810': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:08,391 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:57:09,398 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:57:09,402 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39225 2837s 2024-11-24 00:57:09,402 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41395/status 2837s 2024-11-24 00:57:09,402 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:57:09,412 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43687 2837s 2024-11-24 00:57:09,412 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43687 2837s 2024-11-24 00:57:09,412 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:57:09,412 - distributed.worker - INFO - dashboard at: 127.0.0.1:34627 2837s 2024-11-24 00:57:09,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39225 2837s 2024-11-24 00:57:09,412 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:09,412 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:57:09,412 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:09,412 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ym1ylrt4 2837s 2024-11-24 00:57:09,412 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:09,414 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42673 2837s 2024-11-24 00:57:09,414 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42673 2837s 2024-11-24 00:57:09,414 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:57:09,414 - distributed.worker - INFO - dashboard at: 127.0.0.1:38063 2837s 2024-11-24 00:57:09,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39225 2837s 2024-11-24 00:57:09,414 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:09,414 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:57:09,414 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:09,414 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ywz7ts8b 2837s 2024-11-24 00:57:09,414 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:09,415 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43687. Reason: failure-to-start- 2837s 2024-11-24 00:57:09,415 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:09,415 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42673. Reason: failure-to-start- 2837s 2024-11-24 00:57:09,415 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:09,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39225': TLS handshake failed with remote 'tls://127.0.0.1:52868': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:09,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39225': TLS handshake failed with remote 'tls://127.0.0.1:52884': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:09,417 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:57:10,423 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:57:10,427 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33791 2837s 2024-11-24 00:57:10,427 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36227/status 2837s 2024-11-24 00:57:10,427 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:57:10,439 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33327 2837s 2024-11-24 00:57:10,439 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33327 2837s 2024-11-24 00:57:10,439 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:57:10,439 - distributed.worker - INFO - dashboard at: 127.0.0.1:36415 2837s 2024-11-24 00:57:10,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33791 2837s 2024-11-24 00:57:10,439 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:10,439 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:57:10,439 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:10,439 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o18evoox 2837s 2024-11-24 00:57:10,439 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:10,441 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38485 2837s 2024-11-24 00:57:10,441 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38485 2837s 2024-11-24 00:57:10,441 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:57:10,441 - distributed.worker - INFO - dashboard at: 127.0.0.1:33229 2837s 2024-11-24 00:57:10,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33791 2837s 2024-11-24 00:57:10,441 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:10,441 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:57:10,442 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:10,442 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i0az_4f0 2837s 2024-11-24 00:57:10,442 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:10,442 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33327. Reason: failure-to-start- 2837s 2024-11-24 00:57:10,443 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:10,443 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38485. Reason: failure-to-start- 2837s 2024-11-24 00:57:10,443 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:10,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33791': TLS handshake failed with remote 'tls://127.0.0.1:48012': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:10,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33791': TLS handshake failed with remote 'tls://127.0.0.1:48014': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:10,446 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:57:11,452 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:57:11,456 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46603 2837s 2024-11-24 00:57:11,456 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37129/status 2837s 2024-11-24 00:57:11,457 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:57:11,479 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35391 2837s 2024-11-24 00:57:11,479 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35391 2837s 2024-11-24 00:57:11,479 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:57:11,479 - distributed.worker - INFO - dashboard at: 127.0.0.1:46577 2837s 2024-11-24 00:57:11,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46603 2837s 2024-11-24 00:57:11,479 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:11,479 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:57:11,479 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:11,479 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-co8q5l9g 2837s 2024-11-24 00:57:11,479 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:11,481 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41315 2837s 2024-11-24 00:57:11,481 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41315 2837s 2024-11-24 00:57:11,481 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:57:11,481 - distributed.worker - INFO - dashboard at: 127.0.0.1:39021 2837s 2024-11-24 00:57:11,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46603 2837s 2024-11-24 00:57:11,481 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:11,481 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:57:11,481 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:11,481 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mtzsn4xj 2837s 2024-11-24 00:57:11,481 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:11,484 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35391. Reason: failure-to-start- 2837s 2024-11-24 00:57:11,484 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:11,484 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41315. Reason: failure-to-start- 2837s 2024-11-24 00:57:11,484 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:11,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46603': TLS handshake failed with remote 'tls://127.0.0.1:42476': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:11,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46603': TLS handshake failed with remote 'tls://127.0.0.1:42486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:11,487 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:57:12,491 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:57:12,495 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43957 2837s 2024-11-24 00:57:12,495 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36737/status 2837s 2024-11-24 00:57:12,496 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:57:12,506 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44289 2837s 2024-11-24 00:57:12,506 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44289 2837s 2024-11-24 00:57:12,506 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:57:12,506 - distributed.worker - INFO - dashboard at: 127.0.0.1:36037 2837s 2024-11-24 00:57:12,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43957 2837s 2024-11-24 00:57:12,506 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:12,506 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:57:12,506 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:12,506 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x4l9fdv1 2837s 2024-11-24 00:57:12,506 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:12,508 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43467 2837s 2024-11-24 00:57:12,508 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43467 2837s 2024-11-24 00:57:12,508 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:57:12,508 - distributed.worker - INFO - dashboard at: 127.0.0.1:43637 2837s 2024-11-24 00:57:12,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43957 2837s 2024-11-24 00:57:12,508 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:12,508 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:57:12,509 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:12,509 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_yqz69my 2837s 2024-11-24 00:57:12,509 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:12,510 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44289. Reason: failure-to-start- 2837s 2024-11-24 00:57:12,510 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:12,510 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43467. Reason: failure-to-start- 2837s 2024-11-24 00:57:12,510 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:12,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43957': TLS handshake failed with remote 'tls://127.0.0.1:60914': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:12,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43957': TLS handshake failed with remote 'tls://127.0.0.1:60930': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:12,512 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:57:13,517 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:57:13,520 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44967 2837s 2024-11-24 00:57:13,521 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42433/status 2837s 2024-11-24 00:57:13,521 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:57:13,530 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40825 2837s 2024-11-24 00:57:13,531 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40825 2837s 2024-11-24 00:57:13,531 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:57:13,531 - distributed.worker - INFO - dashboard at: 127.0.0.1:45911 2837s 2024-11-24 00:57:13,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44967 2837s 2024-11-24 00:57:13,531 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:13,531 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:57:13,531 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:13,531 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-89jq37mu 2837s 2024-11-24 00:57:13,531 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:13,532 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36475 2837s 2024-11-24 00:57:13,532 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36475 2837s 2024-11-24 00:57:13,532 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:57:13,533 - distributed.worker - INFO - dashboard at: 127.0.0.1:40809 2837s 2024-11-24 00:57:13,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44967 2837s 2024-11-24 00:57:13,533 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:13,533 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:57:13,533 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:13,533 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pap3mp3e 2837s 2024-11-24 00:57:13,533 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:13,534 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40825. Reason: failure-to-start- 2837s 2024-11-24 00:57:13,534 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:13,534 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36475. Reason: failure-to-start- 2837s 2024-11-24 00:57:13,534 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:13,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44967': TLS handshake failed with remote 'tls://127.0.0.1:48306': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:13,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44967': TLS handshake failed with remote 'tls://127.0.0.1:48308': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:13,536 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s 2024-11-24 00:57:14,541 - distributed.scheduler - INFO - State start 2837s 2024-11-24 00:57:14,546 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43419 2837s 2024-11-24 00:57:14,546 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34647/status 2837s 2024-11-24 00:57:14,547 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2837s 2024-11-24 00:57:14,557 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40915 2837s 2024-11-24 00:57:14,558 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40915 2837s 2024-11-24 00:57:14,558 - distributed.worker - INFO - Worker name: 0 2837s 2024-11-24 00:57:14,558 - distributed.worker - INFO - dashboard at: 127.0.0.1:45253 2837s 2024-11-24 00:57:14,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43419 2837s 2024-11-24 00:57:14,558 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:14,558 - distributed.worker - INFO - Threads: 1 2837s 2024-11-24 00:57:14,558 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:14,558 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d0ynvg65 2837s 2024-11-24 00:57:14,558 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:14,560 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45165 2837s 2024-11-24 00:57:14,560 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45165 2837s 2024-11-24 00:57:14,560 - distributed.worker - INFO - Worker name: 1 2837s 2024-11-24 00:57:14,560 - distributed.worker - INFO - dashboard at: 127.0.0.1:44591 2837s 2024-11-24 00:57:14,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43419 2837s 2024-11-24 00:57:14,560 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:14,560 - distributed.worker - INFO - Threads: 2 2837s 2024-11-24 00:57:14,560 - distributed.worker - INFO - Memory: 7.73 GiB 2837s 2024-11-24 00:57:14,560 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7ozkut6h 2837s 2024-11-24 00:57:14,560 - distributed.worker - INFO - ------------------------------------------------- 2837s 2024-11-24 00:57:14,561 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40915. Reason: failure-to-start- 2837s 2024-11-24 00:57:14,561 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:14,562 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45165. Reason: failure-to-start- 2837s 2024-11-24 00:57:14,562 - distributed.worker - INFO - Closed worker has not yet started: Status.init 2837s 2024-11-24 00:57:14,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43419': TLS handshake failed with remote 'tls://127.0.0.1:43706': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:14,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43419': TLS handshake failed with remote 'tls://127.0.0.1:43716': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 2837s 2024-11-24 00:57:14,564 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 2837s await self._register_with_scheduler() 2837s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 2837s comm = await connect(self.scheduler.address, **self.connection_args) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2837s comm = await wait_for( 2837s ^^^^^^^^^^^^^^^ 2837s ...<2 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 2837s return await fut 2837s ^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2837s stream = await self.client.connect( 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2837s af, addr, stream = await connector.start(connect_timeout=timeout) 2837s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2837s asyncio.exceptions.CancelledError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 2837s await wait_for(self.start_unsafe(), timeout=timeout) 2837s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 2837s async with asyncio.timeout(timeout): 2837s ~~~~~~~~~~~~~~~^^^^^^^^^ 2837s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 2837s raise TimeoutError from exc_val 2837s TimeoutError 2837s 2837s The above exception was the direct cause of the following exception: 2837s 2837s Traceback (most recent call last): 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 2837s s, ws = await start_cluster( 2837s ^^^^^^^^^^^^^^^^^^^^ 2837s ...<9 lines>... 2837s ) 2837s ^ 2837s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 2837s await asyncio.gather(*workers) 2837s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 2837s return await awaitable 2837s ^^^^^^^^^^^^^^^ 2837s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 2837s raise asyncio.TimeoutError( 2837s f"{type(self).__name__} start timed out after {timeout}s." 2837s ) from exc 2837s TimeoutError: Worker start timed out after 0s. 2837s ============================= slowest 20 durations ============================= 2837s 300.02s setup tests/test_utils_test.py::test_tls_cluster 2837s 60.14s call tests/test_tls_functional.py::test_worker_client_executor 2837s 60.01s call tests/test_tls_functional.py::test_work_stealing 2837s 60.01s call tests/test_scheduler.py::test_broadcast_tls 2837s 60.01s call tests/test_utils_test.py::test_gen_cluster_tls 2837s 60.01s call tests/test_tls_functional.py::test_Queue 2837s 60.00s call tests/test_tls_functional.py::test_basic 2837s 60.00s call tests/test_tls_functional.py::test_scatter 2837s 60.00s call tests/test_tls_functional.py::test_worker_client_gather 2837s 60.00s call tests/test_tls_functional.py::test_retire_workers 2837s 60.00s call tests/test_tls_functional.py::test_gather 2837s 60.00s call tests/test_tls_functional.py::test_rebalance 2837s 60.00s call tests/test_tls_functional.py::test_client_submit 2837s 60.00s call tests/test_tls_functional.py::test_worker_client 2837s 60.00s call tests/test_tls_functional.py::test_nanny 2837s 30.01s call tests/test_tls_functional.py::test_security_dict_input 2837s 10.02s call tests/test_utils_test.py::test_popen_timeout 2837s 7.03s call shuffle/tests/test_rechunk.py::test_rechunk_method 2837s 6.45s call tests/test_failed_workers.py::test_worker_doesnt_await_task_completion 2837s 5.92s call tests/test_nanny.py::test_num_fds 2837s =========================== short test summary info ============================ 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_ssh.py:9: could not import 'paramiko': No module named 'paramiko' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx.py:15: could not import 'ucp': No module named 'ucp' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx_config.py:22: could not import 'ucp': No module named 'ucp' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_components.py:5: could not import 'bokeh': No module named 'bokeh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_scheduler_bokeh.py:11: could not import 'bokeh': No module named 'bokeh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_worker_bokeh.py:10: could not import 'bokeh': No module named 'bokeh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py:7: could not import 'paramiko': No module named 'paramiko' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_ssh.py:5: could not import 'asyncssh': No module named 'asyncssh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_cudf_diagnostics.py:20: could not import 'cudf': No module named 'cudf' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memray.py:5: could not import 'memray': No module named 'memray' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nvml.py:10: could not import 'pynvml': No module named 'pynvml' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_stream.py:5: could not import 'bokeh': No module named 'bokeh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_widgets.py:14: could not import 'ipywidgets': No module named 'ipywidgets' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_rmm_diagnostics.py:14: could not import 'dask_cuda': No module named 'dask_cuda' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_arrow.py:5: could not import 'pyarrow': No module named 'pyarrow' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_cupy.py:11: could not import 'cupy': No module named 'cupy' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py:8: could not import 'h5py': No module named 'h5py' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_keras.py:5: could not import 'keras': No module named 'keras' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_netcdf4.py:5: could not import 'netCDF4': No module named 'netCDF4' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numba.py:11: could not import 'numba.cuda': No module named 'numba' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_rmm.py:10: could not import 'numba.cuda': No module named 'numba' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py:8: could not import 'scipy': No module named 'scipy' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_sparse.py:6: could not import 'sparse': No module named 'sparse' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_torch.py:8: could not import 'torch': No module named 'torch' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_graph.py:9: could not import 'pyarrow': No module named 'pyarrow' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge.py:71: could not import 'pyarrow': No module named 'pyarrow' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge_column_and_index.py:110: could not import 'pyarrow': No module named 'pyarrow' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_metrics.py:71: could not import 'pyarrow': No module named 'pyarrow' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle.py:195: could not import 'pyarrow': No module named 'pyarrow' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_parse_stdout.py:14: could not import 'parse_stdout': No module named 'parse_stdout' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:75: could not import 'bokeh': No module named 'bokeh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:107: could not import 'bokeh': No module named 'bokeh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:154: could not import 'bokeh': No module named 'bokeh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:291: could not import 'bokeh': No module named 'bokeh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:497: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:509: need --runslow option to run 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:569: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:169: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:194: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:264: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:290: need --runslow option to run 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:309: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:345: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:368: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:375: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:383: need --runslow option to run 2837s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:397: need --runslow option to run 2837s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:431: need --runslow option to run 2837s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:468: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:487: need --runslow option to run 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:525: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:536: need --runslow option to run 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:546: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:589: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:606: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:625: need --runslow option to run 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:639: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:726: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:77: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:91: Windows-specific error testing (distributed#7434) 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py:16: could not import 'bokeh': No module named 'bokeh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py:143: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py:49: need --runslow option to run 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py:79: could not import 'matplotlib': No module named 'matplotlib' 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py:108: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py:140: could not import 'bokeh.models': No module named 'bokeh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py:151: could not import 'bokeh.models': No module named 'bokeh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py:35: could not import 'bokeh': No module named 'bokeh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py:59: could not import 'bokeh': No module named 'bokeh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:86: could not import 'bokeh': No module named 'bokeh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:324: could not import 'aiohttp': No module named 'aiohttp' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:437: could not import 'bokeh': No module named 'bokeh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:478: could not import 'aiohttp': No module named 'aiohttp' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:498: could not import 'aiohttp': No module named 'aiohttp' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:521: could not import 'aiohttp': No module named 'aiohttp' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:543: could not import 'aiohttp': No module named 'aiohttp' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:564: could not import 'aiohttp': No module named 'aiohttp' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py:149: could not import 'aiohttp': No module named 'aiohttp' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py:162: could not import 'aiohttp': No module named 'aiohttp' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py:233: Fails on 32-bit, seems to be large memory request 2837s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py:12: could not import 'cupy': No module named 'cupy' 2837s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py:44: could not import 'cudf': No module named 'cudf' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:125: could not import 'lz4': No module named 'lz4' 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'lz4': No module named 'lz4' 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'snappy': No module named 'snappy' 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'zstandard': No module named 'zstandard' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'lz4': No module named 'lz4' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'snappy': No module named 'snappy' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'zstandard': No module named 'zstandard' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'lz4': No module named 'lz4' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'snappy': No module named 'snappy' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'zstandard': No module named 'zstandard' 2837s SKIPPED [10] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:168: need --runslow option to run 2837s SKIPPED [5] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:188: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py:150: could not import 'numpy.core.test_rational': No module named 'numpy.core.test_rational' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py:180: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py:283: need --runslow option to run 2837s SKIPPED [3] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py:213: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py:1252: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1296: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1309: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1331: need --runslow option to run 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1352: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py:158: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py:228: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:853: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:1726: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:1860: unconditional skip 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:2078: unconditional skip 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:2653: unconditional skip 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:2672: Use fast random selection now 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3303: unconditional skip 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3586: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3651: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3763: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4586: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4689: Now prefer first-in-first-out 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4719: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4855: could not import 'scipy': No module named 'scipy' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4998: need --runslow option to run 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5041: need --runslow option to run 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5061: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5088: need --runslow option to run 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5101: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5289: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5308: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5603: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5845: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6046: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6163: unconditional skip 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6377: could not import 'bokeh.plotting': No module named 'bokeh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6726: known intermittent failure 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6807: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6870: On Py3.10+ semaphore._loop is not bound until .acquire() blocks 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6890: On Py3.10+ semaphore._loop is not bound until .acquire() blocks 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6899: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7305: could not import 'bokeh': No module named 'bokeh' 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7406: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7501: numpy >=1.25 can capture ufunc code 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7645: need --runslow option to run 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:8396: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py:146: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py:356: could not import 'uvloop': No module named 'uvloop' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:602: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:1026: could not import 'crick': No module named 'crick' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:1035: could not import 'crick': No module named 'crick' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:1487: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py:13: no crick library 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py:221: could not import 'sparse': No module named 'sparse' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py:224: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:41: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:117: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:128: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:286: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:357: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:441: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:453: need --runslow option to run 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:474: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:520: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_jupyter.py:47: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py:31: WindowsTime doesn't work with high accuracy base timer 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:93: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:107: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:141: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:269: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:468: need --runslow option to run 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:545: could not import 'ucp': No module named 'ucp' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:632: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:640: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:681: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:724: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py:75: could not import 'stacktrace': No module named 'stacktrace' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py:113: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:363: Skipped 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:420: Should protect resource keys from optimization 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:441: atop fusion seemed to break this 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:305: Not relevant with queuing on; see https://github.com/dask/distributed/issues/7204 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:440: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1087: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1115: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1136: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1228: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1246: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1638: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1691: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1708: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1871: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1911: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2102: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2361: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2450: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2471: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2506: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2549: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2604: could not import 'bokeh': No module named 'bokeh' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2980: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3394: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3573: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3605: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3748: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3805: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3825: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:4064: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:106: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:285: Skipped 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:1287: executing heartbeats not considered yet 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:1353: need --runslow option to run 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:51: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:96: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:202: unconditional skip 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:233: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:260: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:301: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py:111: could not import 'gilknocker': No module named 'gilknocker' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py:167: could not import 'IPython': No module named 'IPython' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py:357: could not import 'pyarrow': No module named 'pyarrow' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_perf.py:86: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:149: This hangs on travis 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:442: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:603: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:816: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py:194: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:219: don't yet support uploading pyc files 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:309: could not import 'crick': No module named 'crick' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:345: need --runslow option to run 2837s SKIPPED [8] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:420: need --runslow option to run 2837s SKIPPED [5] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:561: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1207: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1287: need --runslow option to run 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1476: could not import 'ucp': No module named 'ucp' 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1540: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1572: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1603: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1630: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1658: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1725: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1830: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:2729: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:3421: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:3451: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py:871: need --runslow option to run 2837s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py:883: need --runslow option to run 2837s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py:997: need --runslow option to run 2837s FAILED cli/tests/test_dask_scheduler.py::test_preload_file - distributed.comm.core.CommClosedError: in : Stream is closed 2837s FAILED cli/tests/test_dask_scheduler.py::test_preload_module - distributed.comm.core.CommClosedError: in : Stream is closed 2837s FAILED cli/tests/test_dask_scheduler.py::test_preload_remote_module - SystemError: no locals when deleting 2837s FAILED cli/tests/test_dask_scheduler.py::test_preload_config - SystemError: no locals found when setting up annotations 2837s FAILED cli/tests/test_dask_scheduler.py::test_preload_command - distributed.comm.core.CommClosedError: in : Stream is closed 2837s FAILED cli/tests/test_dask_scheduler.py::test_preload_command_default - distributed.comm.core.CommClosedError: in : Stream is closed 2837s FAILED cli/tests/test_dask_scheduler.py::test_multiple_workers_2 - SystemError: no locals found when setting up annotations 2837s FAILED cli/tests/test_tls_cli.py::test_basic - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s FAILED cli/tests/test_tls_cli.py::test_sni - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s FAILED cli/tests/test_tls_cli.py::test_nanny - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s FAILED cli/tests/test_tls_cli.py::test_separate_key_cert - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s FAILED cli/tests/test_tls_cli.py::test_use_config_file - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 2837s FAILED deploy/tests/test_subprocess.py::test_basic - SystemError: no locals found when setting up annotations 2837s FAILED deploy/tests/test_subprocess.py::test_n_workers - SystemError: no locals found when setting up annotations 2837s FAILED tests/test_client.py::test_upload_file_zip - KeyError: '/tmp/dask-scratch-space/scheduler-irr8s021/myfile.zip' 2837s FAILED tests/test_profile.py::test_info_frame_f_lineno[22-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 2837s FAILED tests/test_profile.py::test_info_frame_f_lineno[23-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 2837s FAILED tests/test_profile.py::test_call_stack_f_lineno[22-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 2837s FAILED tests/test_profile.py::test_call_stack_f_lineno[23-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 2837s FAILED tests/test_scheduler.py::test_broadcast_tls - TimeoutError 2837s FAILED tests/test_security.py::test_repr_temp_keys - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 2837s FAILED tests/test_security.py::test_temporary_credentials - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 2837s FAILED tests/test_security.py::test_extra_conn_args_in_temporary_credentials - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 2837s FAILED tests/test_tls_functional.py::test_basic - TimeoutError 2837s FAILED tests/test_tls_functional.py::test_Queue - TimeoutError 2837s FAILED tests/test_tls_functional.py::test_client_submit - TimeoutError 2837s FAILED tests/test_tls_functional.py::test_gather - TimeoutError 2837s FAILED tests/test_tls_functional.py::test_scatter - TimeoutError 2837s FAILED tests/test_tls_functional.py::test_nanny - TimeoutError 2837s FAILED tests/test_tls_functional.py::test_rebalance - TimeoutError 2837s FAILED tests/test_tls_functional.py::test_work_stealing - TimeoutError 2837s FAILED tests/test_tls_functional.py::test_worker_client - TimeoutError 2837s FAILED tests/test_tls_functional.py::test_worker_client_gather - TimeoutError 2837s FAILED tests/test_tls_functional.py::test_worker_client_executor - TimeoutError 2837s FAILED tests/test_tls_functional.py::test_retire_workers - TimeoutError 2837s FAILED tests/test_tls_functional.py::test_security_dict_input - TimeoutError 2837s FAILED tests/test_utils_test.py::test_gen_cluster_tls - TimeoutError 2837s ERROR tests/test_utils_test.py::test_tls_cluster - Failed: Timeout >300.0s 2837s = 37 failed, 2853 passed, 306 skipped, 159 deselected, 15 xfailed, 8 xpassed, 1 error in 2197.95s (0:36:37) = 2839s *** END OF RUN 1: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 2839s *** STARTING RUN 2: python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=cli/tests/test_dask_scheduler.py::test_defaults --deselect=cli/tests/test_dask_scheduler.py::test_hostport --deselect=cli/tests/test_dask_spec.py::test_errors --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=dashboard/tests/test_worker_bokeh.py::test_counters --deselect=deploy/tests/test_local.py::test_adapt_then_manual --deselect=deploy/tests/test_local.py::test_async_with --deselect=deploy/tests/test_local.py::test_close_twice --deselect=deploy/tests/test_local.py::test_cluster_info_sync --deselect=deploy/tests/test_local.py::test_local_tls --deselect=deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=deploy/tests/test_local.py::test_only_local_access --deselect=deploy/tests/test_local.py::test_remote_access --deselect=diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=protocol/tests/test_serialize.py::test_errors --deselect=tests/test_batched.py::test_BatchedSend --deselect=tests/test_batched.py::test_close_closed --deselect=tests/test_batched.py::test_close_twice --deselect=tests/test_batched.py::test_send_after_stream_start --deselect=tests/test_batched.py::test_send_before_close --deselect=tests/test_batched.py::test_send_before_start --deselect=tests/test_batched.py::test_sending_traffic_jam --deselect=tests/test_batched.py::test_serializers --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_async_with --deselect=tests/test_client.py::test_client_is_quiet_cluster_close --deselect=tests/test_client.py::test_dashboard_link_cluster --deselect=tests/test_client.py::test_dashboard_link_inproc --deselect=tests/test_client.py::test_file_descriptors_dont_leak --deselect=tests/test_client.py::test_mixing_clients_different_scheduler --deselect=tests/test_client.py::test_quiet_client_close --deselect=tests/test_client.py::test_rebalance_sync --deselect=tests/test_client.py::test_repr_localcluster --deselect=tests/test_client.py::test_security_loader --deselect=tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_shutdown --deselect=tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=tests/test_client.py::test_shutdown_localcluster --deselect=tests/test_client.py::test_shutdown_stops_callbacks --deselect=tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=tests/test_core.py::test_close_fast_without_active_handlers --deselect=tests/test_core.py::test_close_grace_period_for_handlers --deselect=tests/test_core.py::test_close_properly --deselect=tests/test_core.py::test_compression --deselect=tests/test_core.py::test_connection_pool --deselect=tests/test_core.py::test_connection_pool_close_while_connecting --deselect=tests/test_core.py::test_connection_pool_detects_remote_close --deselect=tests/test_core.py::test_connection_pool_outside_cancellation --deselect=tests/test_core.py::test_connection_pool_remove --deselect=tests/test_core.py::test_connection_pool_respects_limit --deselect=tests/test_core.py::test_connection_pool_tls --deselect=tests/test_core.py::test_counters --deselect=tests/test_core.py::test_deserialize_error --deselect=tests/test_core.py::test_errors --deselect=tests/test_core.py::test_identity_inproc --deselect=tests/test_core.py::test_identity_tcp --deselect=tests/test_core.py::test_large_packets_inproc --deselect=tests/test_core.py::test_messages_are_ordered_bsend --deselect=tests/test_core.py::test_messages_are_ordered_raw --deselect=tests/test_core.py::test_ports --deselect=tests/test_core.py::test_rpc_default --deselect=tests/test_core.py::test_rpc_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_default --deselect=tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=tests/test_core.py::test_rpc_serialization --deselect=tests/test_core.py::test_rpc_tcp --deselect=tests/test_core.py::test_rpc_tls --deselect=tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=tests/test_core.py::test_send_recv_args --deselect=tests/test_core.py::test_send_recv_cancelled --deselect=tests/test_core.py::test_server --deselect=tests/test_core.py::test_server_comms_mark_active_handlers --deselect=tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_locks.py::test_errors --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=tests/test_preload.py::test_preload_import_time --deselect=tests/test_preload.py::test_preload_manager_sequence --deselect=tests/test_preload.py::test_worker_preload_text --deselect=tests/test_scheduler.py::test_allowed_failures_config --deselect=tests/test_scheduler.py::test_async_context_manager --deselect=tests/test_scheduler.py::test_dashboard_host --deselect=tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=tests/test_scheduler.py::test_finished --deselect=tests/test_scheduler.py::test_multiple_listeners --deselect=tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_security.py::test_require_encryption --deselect=tests/test_security.py::test_tls_listen_connect --deselect=tests/test_security.py::test_tls_temporary_credentials_functional --deselect=tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=tests/test_utils_test.py::test_ensure_no_new_clients --deselect=tests/test_utils_test.py::test_freeze_batched_send --deselect=tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=tests/test_worker.py::test_plugin_exception --deselect=tests/test_worker.py::test_plugin_internal_exception --deselect=tests/test_worker.py::test_plugin_multiple_exceptions --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker_client.py::test_dont_override_default_get 2841s ============================= test session starts ============================== 2841s platform linux -- Python 3.13.0, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.13 2841s cachedir: .pytest_cache 2841s rootdir: /tmp/autopkgtest.Vx887U/autopkgtest_tmp/build 2841s configfile: pyproject.toml 2841s plugins: typeguard-4.4.1, timeout-2.3.1, rerunfailures-14.0, anyio-4.6.2 2841s timeout: 300.0s 2841s timeout method: signal 2841s timeout func_only: False 2852s collecting ... collected 3349 items / 3311 deselected / 30 skipped / 38 selected 2852s run-last-failure: rerun previous 38 failures 2852s 2854s cli/tests/test_dask_scheduler.py::test_preload_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 2%] 2855s cli/tests/test_dask_scheduler.py::test_preload_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 5%] 2857s cli/tests/test_dask_scheduler.py::test_preload_remote_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 7%] 2859s cli/tests/test_dask_scheduler.py::test_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 10%] 2861s cli/tests/test_dask_scheduler.py::test_preload_command <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 13%] 2862s cli/tests/test_dask_scheduler.py::test_preload_command_default <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 15%] 2865s cli/tests/test_dask_scheduler.py::test_multiple_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 18%] 2869s cli/tests/test_tls_cli.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 21%] 2872s cli/tests/test_tls_cli.py::test_sni <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 23%] 2875s cli/tests/test_tls_cli.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 26%] 2877s cli/tests/test_tls_cli.py::test_separate_key_cert <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 28%] 2880s cli/tests/test_tls_cli.py::test_use_config_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 31%] 2882s deploy/tests/test_subprocess.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py FAILED [ 34%] 2884s deploy/tests/test_subprocess.py::test_n_workers <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py FAILED [ 36%] 2885s tests/test_client.py::test_upload_file_zip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py FAILED [ 39%] 2885s tests/test_profile.py::test_info_frame_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 42%] 2885s tests/test_profile.py::test_info_frame_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 44%] 2885s tests/test_profile.py::test_call_stack_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 47%] 2885s tests/test_profile.py::test_call_stack_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 50%] 2945s tests/test_scheduler.py::test_broadcast_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py FAILED [ 52%] 2946s tests/test_security.py::test_repr_temp_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 55%] 2946s tests/test_security.py::test_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 57%] 2946s tests/test_security.py::test_extra_conn_args_in_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 60%] 3006s tests/test_tls_functional.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 63%] 3067s tests/test_tls_functional.py::test_Queue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 65%] 3127s tests/test_tls_functional.py::test_client_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 68%] 3188s tests/test_tls_functional.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 71%] 3248s tests/test_tls_functional.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 73%] 3308s tests/test_tls_functional.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 76%] 3369s tests/test_tls_functional.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 78%] 4574s tests/test_tls_functional.py::test_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py autopkgtest-virt-ssh [01:33:45]: ------- nova console-log b716ba8b-d2d1-4b6d-8790-a47063bf01f7 (adt-plucky-arm64-dask.distributed-20241123-203206-juju-7f2275-prod-proposed-migration-environment-20-5e55d8b5-433b-4605-8343-758bb674b3c2) ------ 4574s ERROR (CommandError): No server with a name or ID of 'b716ba8b-d2d1-4b6d-8790-a47063bf01f7' exists. 4574s --------------------------------------------------- 4574s ------- nova show b716ba8b-d2d1-4b6d-8790-a47063bf01f7 (adt-plucky-arm64-dask.distributed-20241123-203206-juju-7f2275-prod-proposed-migration-environment-20-5e55d8b5-433b-4605-8343-758bb674b3c2) ------ 4574s ERROR (CommandError): No server with a name or ID of 'b716ba8b-d2d1-4b6d-8790-a47063bf01f7' exists. 4574s --------------------------------------------------- 4574s 6163s nova [W] Skipping flock in bos03-arm64 6163s Creating nova instance adt-plucky-arm64-dask.distributed-20241123-203206-juju-7f2275-prod-proposed-migration-environment-20-5e55d8b5-433b-4605-8343-758bb674b3c2 from image adt/ubuntu-plucky-arm64-server-20241119.img (UUID 254dc414-4366-404b-b85c-a4e26b3194ad)... 6163s nova [W] Skipping flock in bos03-arm64 6163s Creating nova instance adt-plucky-arm64-dask.distributed-20241123-203206-juju-7f2275-prod-proposed-migration-environment-20-5e55d8b5-433b-4605-8343-758bb674b3c2 from image adt/ubuntu-plucky-arm64-server-20241119.img (UUID 254dc414-4366-404b-b85c-a4e26b3194ad)... 6163s ERROR (CommandError): Unable to delete the specified server(s). 6163s autopkgtest [02:00:14]: ERROR: testbed failure: testbed auxverb failed with exit code 255